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BRIEF 

Requirement  : 

1)  To  apply  a  systems  approach  to  the  analysis  of  Army  personnel 
system  problems  at  the  company  level. 

2)  Development  of  a  unit  personnel  management  monitoring  system,  based 
on  the  results  of  the  analysis  above. 

Procedure  : 

Survey  and  record  data  measures  of  a  broad  range  of  variables  were 
collected  from  60  combat  line  companies.  Data  were  collected  at  three  con¬ 
secutive  points  in  time,  approximately  two  months  apart.  Factor  and  item 
analyses  were  used  to  identify  the  primary  company-level  sources  of  variance 
in  the  survey  data  and  to  develop  measures  of  them.  The  resulting  measures 
were  used  as  basic  components  in  a  system  model.  Inter-relationships  between 
the  model  components  were  determined  by  examining  the  correlations  between  them. 
To  integrate  the  record  data  indicators  into  the  model,  correlations  were  cal¬ 
culated  between  record  data  variables  and  survey  measures.  Record  data  variables 
showing  significant  correlations  with  the  survey  measures  were  included  in  the 
final  model.  The  relationships  depicted  in  the  resulting  model  were  used  to 
develop  a  prototype  unit  personnel  management  monitoring  system. 

Findings  : 

Factor  and  item  analyses  of  the  survey  data  resulted  in  seven  perceptual 
model  components.  They  were  Leadership  Climate,  Leader  Strictness,  Enlisted 
Cohesion,  Enlisted  Commitment,  Racial  Climate,  Moral  Climate,  and  Unit  Effect¬ 
iveness.  Almost  all  of  the  possible  inter-correlations  between  these  seven 
components  were  significant,  indicating  that  the  concepts  represented  in  the 
model  are  highly  inter-related,  possibly  because  of  some  underlying  affect 
variable  such  as  general  satisfaction  or  dissatisfaction  with  the  unit. 


With  record  data  indicators  were  correlated  with  the  perceptual  meas¬ 
ures,  a  number  of  significant  relationships  were  found.  The  stongest  of 
these  was  a  positive  effect  of  officer  experience.  That  is,  the  longer  a 
unit's  officers  hac^been  in  the  service,  the  more  positive  the  perceptions 
of  the  unit  were.  Other  positive  effects  on  the  unit  were  NCO  experience, 
awards  and  commendations,  and  enlisted  turbulence.  On  the  other  hand, 
officer  turbulence  had  a  negative  impact  on  perceptions  of  the  unit,  as 
did  Article  15s,  AUOLs,  MP  reports,  high  GTAS  scores,  promotions,  and 
the  percent  minority  soldiers. 

Two  approaches  were  examined  for  the  monitoring  system.  The  first 
used  a  small  survey  developed  from  a  subset  of  the  items  used  in  the  system 
modeling,  and  the  second  involved  monitoring  key  record  data  variables. 

After  examination  of  the  two  approaches,  the  survey  approach  was  rejected 
because  of  the  level  of  user  effort  required.  Consequently,  the  record 
data  approach  was  selected  and  a  worksheet  was  designed  to  assist  commanders 
in  monitoring  their  Article  15s,  MP  reports,  AMOLs,  and  promotior.v,  all 
of  which  were  found  to  be  secondary  Indicators  of  unit  effectiveness  in 
the  system  modeling. 

Utilization: 

The  findings  of  this  study  could  be  utilized  at  two  different  levels. 

The  findings  on  turbulence,  GTAS  scores,  and  officer  experience  may  be  of 
interest  to  policy  analysts.  They  raise  some  interesting  questions  about 
a  number  of  current  or  anticipated  Army  policies,  although  because  of  the 
small  sample  size  and  general  nature  of  this  study,  these  findings  should 
be  treated  as  suggestive  rather  than  definitive.  The  findings  on  Article 
15s,  AUOLs,  and  MP  reports  could  be  useful  to  unit  commanders  in  performing 
their  leadership  and  personnel  management  tasks.  The  reports  contains  a 
prototype  work  sheet  which  unit  commanders  can  use  to  monitor  these  key 
variables  in  their  units. 
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Social  Psychological  and  Institutional  Correlates  of 
Unit  Effectiveness 

This  report  presents  an  extended  analysis  of  data  collected  during  a 
previous  effort,  which  was  designed  to  investigate  the  impact  of  racial  har¬ 
mony  and  leadership  on  unit  effectiveness  at  the  company  level  (Griesemer, 

Note  1).  For  this  earlier  project  (which  is  referred  to  as  Task  A),  survey 
and  record  data  measures  of  racial  harmony,  leadership,  and  unit  effective¬ 
ness  were  collected  from  60  combat  line  companies  at  three  consecutive  points 
in  time  approximately  two  months  apart.  These  data  were  used  to  Investigate 
the  fairly  simple  model  of  unit  effectiveness  shown  in  Figure  I,  which  relates 
the  three  concepts  of  leadership,  racial  harmony,  and  unit  effectiveness. 

Uhile  this  simple  model  was  adequate  for  the  purpose  of  the  original 
study  (which  was  to  Investigate  causal  relationships  between  racial  harmony 
and  unit  effectiveness,  and  between  leadership,  racial  harmony,  and  unit 
effectiveness),  it  undoubtedly  represents  a  substantial  simplification  of  the 
complex  social  dynamics  which  operate  in  an  Army  company.  One  of  the  purposes 
of  the  present  study  is  to  develop  a  more  sophisticated  model  of  the  social 
psychological  determinants  of  unit  effectiveness  than  was  used  in  the  previous 
study.  This  goal  was  approached  by:  1)  examining  a  number  of  variables  not 
included  in  the  first  study,  including  a  number  of  institutional  impact  var¬ 
iables  derived  from  the  record  data;  2)  re-defining  some  previously  used 
variables  based  on  empirical  rather  than  a  priori  considerations;  and  3)  using 
an  approach  to  cross-lagged  panel  analysis  which  was  different  from  the  Kenny 
(1973,1975)  model  used  in  the  Task  A  study. 


Effectiveness  impacts  investigated  in  Task  A  (Griesemer,  Note  1) 


A  second  purpose  of  the  present  study  was  to  use  the  resulting  unit 
effectiveness  model  to  develop  hypotheses  relevant  to  a  unit  effectiveness 
monitoring  system.  The  purpose  of  such  a  system  would  be  to  allow  unit  commanders 
to  assess  the  state  of  personnel  system  variables  in  their  units  and  identify 
potential  problem  areas  which  may  impact  on  unit  effectiveness. 

The  remainder  of  this  report  is  divided  into  two  major  sections.  The  first 
section  entitled  "System  Modeling",  describes  the  effort  to  build  a  model  of 
social  psychological  and  institutional  impacts  on  unit  effectiveness.  The  second 
section,  "Unit  Personnel  Management  Monitoring  System",  describes  an  attempt  to 
develop  an  application  of  the  system  model  which  could  be  useful  in  a  field 
setting  for  improving  unit  effectiveness. 
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SYSTEM  MODELING 


The  primary  goal  of  the  system  modeling  effort  was  to  construct  a  model 
of  how  group  personnel  processes  contribute  to  unit  effectiveness  in  Army  in¬ 
fantry  companies.  An  additional  goal  was  to  examine  the  role  of  institutional 
impacts  on  unit  effectiveness. 

Method 

Sample 

The  sample  consisted  of  60  combat  line  companies  drawn  from  two  divisions 
located  in  the  continental  United  States,  with  30  units  selected  from  each  of 
the  two  divisions.  A  sample  of  personnel  from  each  of  the  units  completed  a 
survey  questionnaire  at  three  consecutive  points  in  time,  10  weeks  apart.  For 
each  time  wave,  a  racially  stratified  random  sample  of  18  enlisted  soldiers 
(grades  E1-E4)  was  surveyed  from  each  of  the  companies  under  study.  The  first 
sergeant  and  company  commander  of  each  company  were  also  surveyed.  This  pro¬ 
cedure  resulted  in  a  total  sample  of  3548  subjects. 

Design  and  Procedure 

A  three  wave  panel  design  was  used  for  this  study.  The  three  waves 
consisted  of  three  consecutive  10-week  measurement  periods  during  which  survey 
and  record  data  were  collected  from  each  of  the  60  companies  in  the  sample. 
Record  data  were  accumulated  continuously  throughout  the  study  and  then  aggre¬ 
gated  across  the  appropriate  time  period  to  form  measures  for  each  wave.  During 
the  final  2  weeks  of  each  wave,  survey  data  were  obtained  by  means  of  a  question 
naire  which  requested  respondents  to  answer  retrospectively  for  the  past  8  weeks 

Survey  Instrument.  The  survey  instrument  contained  several  hundred  items 
consisting  of  statements  relating  to  aspects  of  unit  effectiveness,  leadership, 
and  race  relations,  followed  by  Likert-type  response  scales.  Some  of  the 


survey  items  were  newly  constructed  for  the  Task  A  study  while  others  were 
adapted  from  previous  studies.  For  example,  the  survey  used  a  number  of 
leadership  and  organizational  effectiveness  items  from  the  Survey  of  Organi¬ 
zations  (Taylor  &  Bowers,  1972)  and  leadership  items  from  an  adaptation  of  the 
Leader  Behavior  Description  Questionnaire  used  by  Worchel,  Sgro,  and  Cravens 
(Note  2).  Also  included  were  unit  effectiveness  items  from  Bauer,  Stout,  and 
Holz  (Note  3),  and  Hart  (1978,  and  Note  4).  Finally,  racial  climate  items 
were  included  from  Hiett,  McBride,  and  Fiman  (the  RAPS  questionnaire.  Note  5), 
and  from  Boyd  &  Griesemer  (Note  6) . 

Record  Data  Collection.  In  addition  to  the  survey  data,  a  number  of 
record  data  measures  were  collected  for  each  company.  These  measures  included 
counts  of  Article  15s,  Awards,  MP  Reports,  AWOLs,  Unprogrammed  Discharges, 

Sick  Calls,  Unit  Status  Reports,  and  monthly  dumps  of  SIDPERS  computerized 
personnel  files  and  SIDPERS  input  transactions.  For  a  more  complete  description 
of  the  record  data  collection  procedures,  the  survey  instrument,  and  the  samp¬ 
ling  procedures,  see  Griesemer  (Note  1). 

Development  of  the  Model.  In  order  to  build  on  the  results  of  the 
Task  A  study,  it  was  decided  to  re-use  16  of  the  scales  and  seven  of  the  record 
data  measures  which  had  been  developed  previously.  These  measures  are  shown 
in  Table  1,  grouped  according  to  their  placement  in  the  Task  A  model.  Also, 
it  was  decided  to  include  several  new  scales  which  were  developed  during  the 
present  effort.  These  new  scales  were  developed  from  a  previously  unanalyzed 
pool  of  items  which  dealt  with  peer  group  interactions  among  the  El-E4s  and 
with  a  number  of  organizational  factors.  These  areas  were  of  interest  because 
they  correspond  to  variables  which  have  been  included  in  other  studies  of 
organizational  effectiveness  (eg.,  Taylor  &  Bowers,  1972).  Finally,  a  number 
of  new  record  data  measures,  primarily  from  SIDPERS  personnel  files  were  also 
of  interest. 
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Table  1 


Names  of  Survey  and  Record  Data  Measures  Used 
in  the  Task  A  Model 


Measure 


Model  Component 


Survey  Scale 


Record  Data 


Unit  Effectiveness 


Leadership  Climate 


-  Discipline 

-  Cohesion 

-  Preparedness  to  Fight 

-  Unit  Leadership  Rating 

-  Lawbreaking 

-  Marijuana  Use 

-  Insubordination 

-  Leader  Fairness  & 
Consideration 

-  Leader  Sacrifice 

-  Leader  Strictness 

-  Leader  Consultation 
Behaviors 

-  Leader  Problem  Strategies 


-  MP  Reports 

-  AWOLs 

-  Sick  Calls 

-  Unit  Status  Reports 


-  Awards  &  Commendations 

-  Unprogrammed  Discharges 

-  Article  15s 


Overall  Racial  Climate  None 

Overt  Racial  Hostility 
Attitudes  Toward  Integration 
Racial  Solidarity 


Racial  Climate 


Because  the  data  base  to  be  used  in  the  study  consisted  of  only  60 
companies,  there  was  a  substantial  restriction  on  the  number  of  degrees  of 
freedom  available  for  constructing  a  model.  Since  there  were  so  many  variables 
of  interest  in  the  study,  a  number  of  steps  were  taken  to  keep  the  number  of 
variables  in  the  analysis  consistent  with  the  number  of  cases  in  the  data  base. 
One  technique  involved  using  factor  and  item  analyses  to  identify  individual 
survey  measures  which  could  be  combined  to  form  more  global  variables.  The 
resulting  "macro  scales”  were  then  used  in  the  model  building  process  in  place 
of  the  original  scales.  The  factor  analyses  not  only  served  as  a  data  re¬ 
duction  technique,  but  also  served  to  define  the  content  of  the  major  compo¬ 
nents  in  the  model.  This  made  it  possible  to  avoid  the  a  priori  assignment 
of  scales  to  components  in  the  model  as  was  done  in  Task  A. 

The  second  technique,  used  to  avoid  introducing  too  many  variables  into 
the  analysis  at  any  one  time,  involved  breaking  the  analysis  into  phases. 

Each  phase  involved  the  gradual  introduction  of  new  variables  into  the  model 
as  the  role  of  the  previously  entered  variables  was  determined.  In  the  first 
phase,  the  new  survey  scales  from  Task  A  were  factor  analyzed.  In  the  second 
phase,  the  new  survey  scales  relating  to  peer  group  and  organizational  var¬ 
iables  were  developed  from  their  respective  item  pools.  Third,  a  factor  anal¬ 
ysis  was  conducted  to  integrate  the  new  scales  with  the  Task  A  scales.  Fourth, 
the  macro  scales  developed  above  were  used  to  compute  a  cross-lagged  panel 
correlation  matrix  which  formed  a  preliminary  system  model.  Finally,  to  com¬ 
plete  the  system  model,  correlation  coefficients  were  computed  between  the 
record  data  measures  and  the  macro  scales.  Generally,  the  record  data  measures 
were  not  factor  analyzed  to  form  macro  measures  because  the  intercorrelations 
among  the  individual  record  data  variables  were  rather  low.  Instead,  to 
reduce  the  number  of  concepts  in  the  model,  the  record  data  measures  were 


placed  a  priori  Into  logically  connected  groupings.  Conclusions  were 
based  on  the  results  of  the  variables  in  the  group  as  a  whole. 

Correlational  Analysis.  Relationships  between  model  components  were 
identified  using  Pearson  product-moment  correlation  coefficients.  Since 
the  design  of  this  study  provided  data  in  the  form  of  a  three-wave  time 
series*  cross- lagged  panel  analysis  could  have  been  used,  as  it  was  in 
Task  A,  to  attempt  to  identify  causal  relationships  between  the  variables. 
However,  for  reasons  discussed  in  the  Appendix  cross-lagged  panel  analysis 
was  not  used  in  the  present  study. 

As  an  alternative  to  cross-lagged  panel  analysis,  the  present  study 
simply  analyzed  cross-lagged  correlations  by  focusing  on  their  predictive 
value  much  as  would  be  done  in  a  conventional  single  time  study.  However, 
as  the  cross-lagged  correlation  matrix  in  Figure  2  shows,  each  cross- 
lagged  comparison  between  two  variables  (X  and  Y)  in  a  three  wave  design, 
produces  15  individual  correlation  coefficients.  In  order  to  statistically 
test  the  hypothesis  that  the  two  variables  used  to  form  a  cross-lagged 
matrix  are  related,  a  technique  was  used  which  allows  one  to  test  any 
hypothesis  about  a  correlation  matrix  that  states  that  some  of  its  ele¬ 
ments  are  equal  to  each  other  and/or  equal  to  specific  numerical  values 
(Steiger,  1980).  An  hypothesis  of  this  type  is  called  a  pattern  hypo¬ 
thesis.  The  null  pattern  hypothesis  used  in  the  present  study  (which 
is  shown  in  the  lower  half  of  Figure  2) ,  specifies  that  all  of  the  syn¬ 
chronous  and  cross- lagged  correlations  in  the  matrix  are  equal  to  zero. 

The  autocorrelations  in  the  matrix  are  allowed  to  "float"  and  are  not  di¬ 
rectly  involved  in  the  hypothesis  test.  The  pattern  hypothesis  test  pro¬ 
duces  a  single  chi  squared  value  for  rejection  of  the  null  hypothesis, 
and  thus,  is  conceptually  similar  to  the  overall  F  computed  in  analysis  of 
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Although  averaging  correlation  coefficients  Is  not  strictly  correct 
the  distortion  it  produces  in  coefficients  of  the  size  found  in  this 
report  is  quite  small  (only  two  or  three  hundreths  of  a  point  for  the 
largest  correlations,  less  for  the  smaller  ones).  Therefore  averaging 
was  used  instead  of  more  complex  transformations  because  of  its  con¬ 
ceptual  and  computational  simplicity. 
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As  a  first  step  in  the  development  of  macro  scales,  the  16  company 
level  scale  scores  from  Task  A  (which  are  shown  in  Table  1)  were  fac¬ 
tor  analyzed  using  an  iterated  principal  axis  method  followed  by  pro¬ 
max  rotation  of  factors  with  eigenvalues  greater  than  one  (SAS  Institute, 
1979  pp.  203-210).  Promax  rotation  is  an  oblique  rotation  method  which 
produces  correlated  rather  than  independent  (orthogonal)  factors.  Oblique 
rotation  was  used  because  of  the  expectation  that  any  factors  which  ex¬ 
isted  in  the  data  would,  in  fact,  be  intercorrelated,  making  the  constraint 
of  orthogonality  unrealistic.  In  order  to  make  fullest  use  of  the  avail¬ 
able  data,  the  factor  analysis  was  performed  by  concatenating  the  observa¬ 
tions  for  the  60  companies  across  the  three  time  waves.  The  resulting  N 
was  177  (60  companies  times  3  waves,  less  missing  data). 

The  results  of  the  factor  analysis  of  the  Task  A  scales  are  presented 
in  Table  2.  The  table  shows  the  factor  pattern  coefficients  greater 
than  .50  on  each  of  the  rotated  factors.  Pattern  coefficients  were  used 
because  in  an  oblique  rotation  they  indicate  the  clustering  of  items 
more  clearly  than  do  structure  coefficients.  The  composition  of  the  first 
three  factors  is  fairly  clear.  Factor  1  appears  to  be  a  racial  climate 
factor  with  very  high  loadings  on  all  four  racial  climate  scales.  Factor 
2  appears  to  be  a  leadership  climate  factor  consisting  of  the  Unit  Leader¬ 
ship  Rating,  the  Leader  Fairness  &  Consideration  scale,  and  the  Leader 
Sacrifice  scale.  Factor  3,  containing  the  Lawbreaking,  Insubordination, 
and  Marijuana  Use  scales,  was  named  "Moral  Climate".  The  nature  of  the 


Table  2 


Factor  Pattern  Coefficients  Greater  than  .50 


Macro 

Scale 

Designation 

(if  any)  Scale  Name 


Racial  Overall  Racial  Climate 

Climate  Overt  Racial  Hostility 

Attitudes  Toward  Integration 
Racial  Solidarity 


Leadership  Unit  Leadership  Rating 

Climate  Leader  Fairness  &  Consideration 

Leader  Sacrifice 


Lawbreaking 
Insubordination 
Marijuana  Use 


Cohesion 

Leader  Strictness 


Discipline 

Preparedness  to  Fight 
Leader  Consultation  Behaviors 
Leader  Problem  Strategies 


fourth  and  final  factor  is  somewhat  less  clear  than  that  of  the  first  three 
factors.  Factor  4  is  made  of  the  Cohesion  scale  with  a  pattern  coefficient 
of  -.82  and  the  Leader  Strictness  scale  with  a  much  lower  coefficient  of 
-.56.  This  factor  is  difficult  to  explain  because  the  item  content  of  these 
two  scales  is  so  different  that  it  is  not  easy  to  conceive  of  them  as 
measures  of  the  same  underlying  construct. 

To  evaluate  the  four  factors  as  possible  macro  scales,  four  alpha  re¬ 
liability  coefficients  were  calculated  using  the  scales  which  loaded  high¬ 
ly  on  each  of  the  four  factors.  Macro  scale  scores  were  calculated  by 
summing  the  standardized  scores  from  the  individual  component  scales. 

The  macro  scales  formed  from  the  first  two  factors.  Racial  Climate  and 
Leadership,  both  exhibited  alphas  of  .88  which  was  considered  high  enough 
for  them  to  be  used  as  macro  scales.  Consequently,  their  component 
scales  were  removed  from  subsequent  factor  and  item  analyses.  The  other 
two  factors.  Moral  Climate  and  Cohesion/Strictness,  exhibited  relatively 
weak  alphas  (.69  and  .62  respectively),  and  were  not  designated  as  macro 
scales  at  this  point  in  the  analysis. 

Development  of  Enlisted  Commitment  and  Organizational  Scales 

The  Taylor  and  Bowers  (1972)  model  of  organizational  effectiveness, 
upon  which  the  Survey  of  Organizations  (S00)  was  based,  contains  a  num¬ 
ber  of  components  which  seemed  relevant  to  the  concept  of  unit  effective¬ 
ness  and  which  had  not  been  included  in  the  Task  A  model.  These  con¬ 
cepts  included  peer  group  leadership,  organizational  climate,  and  group 
processes.  An  attempt  was  made  to  include  these  concepts  in  the  present 
study  by  developing  a  set  of  survey  scales  from  a  pool  of  questionnaire 
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items  which  had  not  been  analyzed  in  Task  A.  These  items  had  some  re¬ 
semblance  to  items  which  comprised  the  original  Taylor  and  Bowers  con¬ 
cepts  and,  in  fact,  a  few  of  the  items  had  been  taken  almost  directly 
from  Taylor  and  Bowers. 

To  develop  these  new  scales,  the  relevant  survey  items  were  divided 
into  two  separate  item  pools  and  factor  analyzed.  One  of  these  pools 
contained  items  which  asked  about  the  enlisted  soldiers  in  the  company, 
and  correspond  to  the  peer  leadership  and  group  processes  concepts. 
Questions  in  the  other  item  pool  dealt  with  organizational  aspects  of 
the  company  or  its  platoons  and  correspond  to  the  organizational  cli¬ 
mate  dimension. 

Separate  factor  analyses  were  conducted  on  each  item  pool.  All  in¬ 
dividual  responses  to  the  survey  across  all  three  waves  were  used,  re¬ 
sulting  in  an  N  of  3317.  Individual  data  were  used  at  this  point  in 
the  analysis  in  order  to  provide  comparability  with  the  scale  develop¬ 
ment  procedures  used  in  Task  A.  Factor  loading  and  reliability  criteria 
were  lowered  somewhat  in  this  phase  of  the  analysis  since  it  was  pre¬ 
liminary  to  the  development  of  the  actual  macro  scales.  As  before,  an 
iterated  principal  axis  factoring  method  was  employed,  and  factors 
with  eigenvalues  greater  than  one  were  retained  for  promax  rotation. 

Table  3  presents  the  results  of  the  factor  analysis  of  the  peer 
item  pool.  Items  loading  on  Factor  1  generally  have  to  do  with  hiding 
mistakes  from  leaders,  but  some  items  also  deal  with  rule  breaking  and 
disrespect  for  leaders.  Taken  together  these  things  seem  to  represent 
a  situation  in  which  the  enlisted  soldiers  have  turned  away  from  their 
leaders  and  their  peers,  and  are  primarily  looking  out  for  their  own 


Scale  Designation 

(If  any)  Item  Description 


Agreement  -  EMs  agree  with  rules  they 

are  asked  to  live  by 
-  EMs  agree  with  leaders  about 
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interests.  Consequently,  this  factor  was  named  EM  Polarization.  Un¬ 
like  the  other  scales  discussed  so  far,  the  scoring  of  the  items  in  the 
EM  Polarization  scale  was  such  that  a  numerically  high  score  represented 
negative  conditions  in  the  unit.  Since  all  the  scales  from  Task  A  had 
been  scored  such  that  a  high  score  represented  a  positive  condition, 
the  scoring  of  EM  Polarization  was  reversed  so  that  it  would  conform 
to  the  Task  A  convention. 

Factor  2  was  somewhat  the  opposite  of  Factor  1.  The  highly  loading 
items  on  this  factor  all  related  to  positive  interactions  between  the 
enlisted  soldiers.  It  was  named  EM  Consideration  and  it  roughly  corre¬ 
sponds  to  the  SOO  Peer  Support  dimension.  Factor  3  contains  two  items 
both  of  which  relate  to  the  extent  to  which  enlisted  soldiers  agree 
with  their  leaders  and  was  called  EM  agreement.  The  fourth  factor  was 
named  EM  goals  because  the  two  items  loading  on  it  ask  whether  the  EM's 
goal  is  to  make  the  company  strong.  Factor  5  contained  those  items  re¬ 
lated  to  the  extent  to  which  EMs  encourage  each  other  to  work  harder. 
This  factor  corresponds  to  the  SOO  Peer  Work  Facilitation  dimension 
(although  the  actual  items  were  taken  from  an  LBDQ  scale  called  "Pro¬ 
duction  Emphasis").  Finally,  the  items  loading  on  Factor  6  concern 
the  extent  to  which  enlisted  soldiers  exercised  good  judgement.  This 
factor  was  named  EM  responsibility. 

The  reliability  of  the  scales  formed  from  the  peer  item  pool  was 
rather  low,  being  .67,  .65,  .75,  .66,  .60,  and  .54  for  Factors  1-6, 
respectively.  However  all  but  Factor  6  were  retained  in  the  analyses 
in  order  to  examine  the  possibility  that  the  individual  scales  might 
combine  to  form  a  macro  scale  with  a  higher  reliability. 


Results  of  the  factor  analysis  of  the  organizational  climate  item 
pool  are  presented  in  Table  4.  In  this  factor  analysis,  two  factors  met 
the  criterion  for  rotation.  The  first  factor  contains  items  which  are 
primarily  related  to  the  performance  of  the  unit  as  a  whole.  The  first 
two  items  in  the  factor  come  from  the  S00  Technological  Readiness  dimen¬ 
sion  which  is  a  subscale  of  Organizational  Climate.  The  other  two  items 
relate  to  how  well  the  members  of  the  unit  plan  together  and  make  good 
decisions.  This  factor  was  named  Unit  Organization  and  had  an  alpha  of 
.77.  Items  in  the  second  factor  dealt  with  disorganization  and  conflict 
in  the  company.  However,  its  alpha  was  only  .59  and  it  was  not  retained 
for  further  analysis. 


Table  4 


Organizational  Item  Pool  Factor  Pattern  of 
Coefficients  Loading  >  .40  on  Rotated  Factors 


Scale  Factor 

Designation  - 

(if  any)  Item  Description  1  2 


Unit 

Organization  -  Company  quick  to  use 

improved  work  methods 

-  Company  equipment  & 
resources  adequate  and 
well  maintained 

-  Does  company  plan  together 
and  coordinate  efforts 

-  Does  company  make  good 
decisions 


-.61 

-.47 

-.76 

-.80 


.48 

.71 

.44 


-  How  often  are  goals  &  policies 
changed 

-  Conflict  between 
platoons 


-  Everyone  gets  in  each  other's 
way 

-  Platoons /sections  are  in 
conflict  with  company 

-  Leader  priorities  not  related 
to  unit  effectiveness 


-  None  - 


I 

Integration  of  New  Scales  and  Task  A  Scales 

The  next  step  in  the  analysis  was  to  determine  if  additional  company 
level  macro  scales  could  be  formed  from  the  remaining  Task  A  scales  and  the  I 

newly  developed  peer  group  and  organizational  scales.  To  do  this  a  third 
factor  analysis  was  conducted  using  the  company  level  scale  scores  from  the 
new  scales  and  the  remaining  Task  A  scales  which  had  not  already  been  used  I 

to  form  the  leadership  and  racial  climate  macro  scales.  The  resulting  factor 
pattern  coefficients  greater  than  .50  are  presented  in  Table  5. 

The  first  factor  shown  in  the  !_able  has  four  highly  loading  scales,  EM  I 

Polarization,  Insubordination,  Lawbreaking,  and  Marijuana  Use.  Because  all 
four  of  these  scales  deal  with  the  incidence  of  various  illegal  activities, 
acts  of  disrespect,  and  other  anti-social  behavior,  the  Moral  Climate  name,  used  ! 

previously  for  the  latter  three  scales,  was  retained.  When  the  scale',  load¬ 
ing  on  Factor  1  were  used  to  form  a  macro  scale,  an  alpha  reliability  of  .80 
was  obtained,  which  was  considered  high  enough  to  justify  retention  in  subse¬ 
quent  analyses . 

The  second  factor  contained  two  highly  loading  items.  Cohesion  and  Leader 
Strictness.  As  was  stated  when  this  factor  appeared  in  the  first  factor  analy-  1 

sis  of  the  Task  A  scales,  these  two  scales  contain  such  different  item  content 
that  it  is  difficult  to  conceive  that  they  are  measures  of  the  same  underlying 
construct.  In  fact,  these  two  scales  form  a  rather  poor  macro  scale  with  a 
reliability  of  only  .62.  Rather,  it  seems  more  reasonable  that  Leader  Strict¬ 
ness  and  EM  Cohesion  are  two  different  variables  which  are  related  either 
causally  or  spuriously.  Therefore,  these  two  scales  were  used  independently 
as  components  in  the  system  model. 

Factor  3  consisted  of  the  three  new  enlisted  peer  group  scales,  Em  Agree¬ 
ment,  EM  Goals,  and  EM  Production  Emphasis.  If  a  company  scored  high  on  the 
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Table  5 


Macro  Scale 
Designation 

(If  any)  Item  Description 


Climate 

EM  Polarization 

Insubordination 

Lawbreaking 

Marijuana  Use 

— 

Cohesion 

Leader  Strictness 

EM 

Commitment 

EM  Agreement 

EM  Goals 

EM  Production  Emphasis 

Unit 

Effectiveness 

Unit  Organization 

Preparedness  to  Fight 
Discipline 

- 

EM  Consideration 

Leader  Consultation  Strategies 
Leader  Problem  Strategies 

factor,  it  would  represent  a  situation  where  the  enlisted  soldiers  were  com¬ 


mitted  to  the  company  and  its  leaders,  and  working  to  make  the  company  effect¬ 
ive;  consequently,  this  factor  was  named  Enlisted  (EM)  Commitment.  When 
these  items  were  used  as  a  macro  scale,  a  reliability  of  .73  was  obtained 
which  was  considered  adequate  for  subsequent  use. 

The  fourth  and  final  factor  extracted  in  the  factor  analysis  consisted  of 
the  new  Unit  Organization  scale,  the  Preparedness  to  Fight  scale,  and  the 
Discipline  scale.  Used  together  as  a  macro  scale  these  measures  exhibited  a 
reliability  of  .81.  This  macro  scale  was  named  Unit  Effectiveness  because 
it  includes  many  items  which  are  commonly  mentioned  as  face  valid  indicators 
of  unit  performance. 

Summary  of  Macro  Scale  Development 

The  four  factor  analyses  presented  above  resulted  in  seven  macro  scales 
which  were  included  in  the  Initial  system  model.  They  were:  Leadership  Cli¬ 
mate;  Leader  Strictness;  Racial  Climate;  EM  Conmitment;  Moral  Climate;  and 
Unit  Effectiveness.  The  final  macro  scales  and  their  individual  component 
scales  are  summarized  in  Table  6. 

Preliminary  System  Model 

The  first  step  in  developing  the  system  model  was  to  examine  the  inter¬ 
correlations  between  the  macro  scales.  As  explained  in  the  method  section, 
unit  level  macro  scale  scores  were  used  to  compute  a  matrix  of  cross-lagged 
comparisons.  Since  each  cross-lagged  comparison  involves  nine  X/Y  correla¬ 
tions,  the  significance  test  used  in  this  analysis  was  a  test  of  the  null  pat¬ 
tern  hypothesis  that  the  synchronous  and  cross-lagged  correlations  equal  zero. 
Table  7  shows  the  probability  of  rejection  of  the  null  pattern  hypothesis 
(Steiger,  1980)  for  each  of  the  comparisons  between  the  macro  scales.  Prob¬ 
abilities  greater  than  .05  are  not  shown.  It  is  obvious  from  Table  7  that 


Table  6 


Final  Macro  Scales  and  Their  Individual  Component  Scales 


Macro  Scale  Name  Alpha 

Component  Scales 

Scale  Origin3 

Leadership  Climate  .88 

-  Leader  Fairness 

Task  A 

-  Leader  Sacrifice 

Task  A 

-  Unit  Leadership  Rating 

Task  A 

Leader  Strictness 

None 

Task  A 

Racial  Climate 

.88 

-  Overall  Racial  Climate 

Task  A 

-  Attitudes  Toward  Integration 

Task  A 

-  Racial  Solidarity 

Task  A 

-  Overt  Racial  Hostility 

Task  A 

EM  Commitment 

.73 

-  EM  Agreement 

Peer  Item  Pool 

-  EM  Goals 

Peer  Item  Pool 

-  EM  Production  Emphasis 

Peer  Item  Pool 

EM  Cohesion 

None 

Task  A 

Moral  Climate 

.80 

-  Insubordination 

-  Lawbreaking 

-  Marijuana  Use 

-  EM  Polarization 

Task  A 

Task  A 

Task  A 

Peer  Item  Pool 

Unit  Effectiveness 

.81 

-  Discipline 

-  Preparedness  to  Fight 

-  Unit  Organization 

Task  A 

Task  A 

Organizational  Item 
Pool 

a.  Item  content  of  scales  from  the  Peer  Item  Pool  and  Organizational  Item  Pool 
can  be  found  in  Tables  3  and  U  respectively. 
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Table  7 

Probabilities  for  Rejection  of  the  Pattern  Hypothesis  That  the  Synchronous  and  Cross-Lagged  Correlations 
_  Equal  Zero  for  Cross-Lagged  Comparisons  Between  the  Macro  Scales3 


there  are  a  large  number  of  significant  correlations  between  the  macro  scales 
In  fact,  the  only  comparisons  which  were  non-significant  involved  the  two  mea¬ 
sures  which  were  not  actually  macro  scales.  Leader  Strictness  and  EM  Cohesion 
The  actual  average  synchronous  and  cross-time  correlations  for  signifi¬ 
cant  comparisons  between  the  model  components  are  shown  graphically  in  Fig¬ 
ure  3.  In  Figure  3  there  are  three  numbers  above  each  upper  arrow,  and  two 
above  each  lower  arrow’.  These  numbers  represent  correlation  coefficients 
that  have  been  averaged  in  the  manner  discussed  previously  in  the  methods 
section  (p.  11).  The  average  synchronous  correlation  is  the  left  most  num¬ 
ber  on  the  upper  path  arrow;  the  next  two  numbers  to  the  right,  one  above 
each  arrow,  are  the  average  cross-lagged  correlations.  The  two  right  most 
numbers  are  the  individual  cross-lagged  correlations  across  two  waves.  The 
direction  of  the  arrows  indicate  the  time  precedence  for  the  cross-lagged 
correlations  above  them,  with  the  arrow  pointing  away  from  the  variable 
measured  first  in  time.  The  figure  shows  that  the  correlations  are  almost 
universally  positive  and,  in  some  cases,  fairly  high. 

Developing  a  system  model  out  of  the  correlations  presented  in  Figure  3 
is  not  a  straight-forward  task.  The  traditional  approach  would  be  to  use 
path  analysis.  However,  the  large  number  of  paths  required  to  represent 
such  highly  intercorrelated  data  would  produce  a  model  which  is  hopelessly 
under  identified.  Estimation  of  such  a  model  would  produce  totally  meaning¬ 
less  path  coefficients.  Two  approaches  were  considered  to  solve  the  under 
identification  problem.  One  was  to  introduce  additional  exogenous  varia¬ 
bles,  which  unfortunately  were  not  available  in  sufficient  numbers  in  this 
case.  The  other  was  to  simplify  the  model  by  deleting  some  of  the  paths. 

One  criterion  which  was  considered  for  deleting  paths  in  the  model  was 
that  of  significant  cross-time  correlations.  An  individual  correlation 
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Figure  3.  Paths  required  to  represent  significant  correlations  between 
perceptual  system  model  components. 
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must  be  greater  than  or  equal  to  .25  to  be  significantly  different  from 
zero  at  the  .05  level  (two  tailed).  If  this  criterion  were  applied  to  the 
average  correlations  in  Figure  3,  then  all  of  the  synchronous  correlations 
would  reach  the  .05  significance  level,  while  a  number  of  cross-time  corre¬ 
lations  would  not.  For  example,  there  were  no  significant  cross-time  corre 
lations  on  the  path  leading  from  EM  Committment  to  Racial  Climate.  Several 
other  variable  pairs  had  no  significant  cross-time  correlations  in  either 
direction,  for  example;  EM  Cohesion  and  EM  Committment,  or  Leadership  Cli¬ 
mate  and  Racial  Climate.  However,  as  the  discussion  on  cross-lagged  panel 
analysis  in  the  Appendix  indicates,  the  small  magnitude  of  these  cross¬ 
time  correlations  may  simply  be  due  to  a  lack  of  correspondence  between  the 
causal  interval  and  the  measurement  interval.  The  significant  synchronous 
correlations  and  the  perceptual  nature  of  these  variables  suggests  that  the 
causal  intervals  of  these  relationships  may  well  be  shorter  than  the  ten- 
week  measurement  interval  used  in  this  study.  Consequently,  it  was  de¬ 
cided  that  lack  of  significant  cross-time  correlations  could  not  be  used 
as  a  criterion  for  deleting  paths  in  the  model. 

Another  possibility  which  was  examined,  was  deleting  all  but  the  di¬ 
rect  paths  leading  to  Unit  Effectiveness.  The  rationale  for  this  manipula¬ 
tion  was  that  unit  effectiveness  was  the  one  concept  which  was  the  most  im¬ 
portant  to  predict  because  of  the  face  validity  of  its  scales.  However, 
rearranging  the  model  in  this  arbitrary  manner  would  be  a  gross  over-sim¬ 
plification  of  the  high  degree  of  intercorrelation  between  various  model 
components  which  is  one  of  the  chief  features  of  these  data. 

The  solution  to  these  problems  was  to  simply  leave  the  model  in  the 
form  shown  in  Figure  3,  which  uses  the  pattern  hypothesis  test  to  identify 
paths  between  the  variables.  The  relative  strength  of  the  paths  and  their 


ability  to  predict  the  model  components  over  time  can  be  judged  from  the 
synchronous  and  cross-time  correlations  shown  on  the  paths.  While  this 
presentation  does  not  allow  a  direct  estimate  of  the  variance  accounted  for 
by  the  relationship  between  two  variables,  as  path  analysis  would,  it  does 
at  least,  present  the  inter-relationships  themselves  accurately. 

One  thing  which  is  interesting,  and  perhaps  useful,  about  the  corre¬ 
lations  in  Figure  3  is  that  they  indicate  that  a  substantial  portion  of  the 
variance  in  perceptions  of  unit  effectiveness  can  be  accounted  for  across 
a  time  span  of  over  two  months  by  concepts  such  as  Racial  Climate,  EM  Co¬ 
hesion,  and  EM  Commitment.  This  means  that  a  commander  can  receive  early 
warning  of  potential  problems  in  unit  effectiveness  by  monitoring  these 
variables.  In  addition,  the  correlations  indicate  that  concepts  represen¬ 
ted  in  the  model  are  interrelated  to  such  an  extent  that  it  can  be  expected 
that  a  substantial  change  in  any  of  them  will  be  followed  by  a  change  in 
the  others.  The  implications  of  this  finding  for  unit  leadership  seem  to 
be  that  a  problem  which  develops  in  one  of  these  areas  cannot  be  dealt  with 
in  isolation.  For  example,  a  racial  problem  cannot  be  viewed  as  just  a  ra¬ 
cial  problem  because  it  may,  in  fact,  be  symptomatic  of  other  problems  in 
the  unit,  or  it  may  be  a  harbinger  of  other  problems  which  have  yet  to  mani¬ 
fest  themselves. 

Another  point  of  interest  in  Figure  3  is  the  relationship  between 
Leadership  Climate  and  Unit  Effectiveness.  Many  studies  have  used  items 
such  as  those  found  in  the  Leader  Fairness  &  Consideration  component  of 
the  Leadership  Climate  measure,  in  order  to  identify  characteristics  of 
successful  leaders.  The  implied  goal  of  these  studies  was  to  develop  in¬ 
formation  which  could  be  used  to  identify  individuals  who  might  become  sue- 


cessful  leaders.  The  data  in  Figure  3  show  that  there  was  a  strong  syn¬ 
chronous  correlation  of  .68  between  the  Leadership  Climate  and  Unit  Effec¬ 
tiveness,  also  that  the  cross-lagged  correlations  with  Unit  Effectiveness 
measured  first  in  time  were  rather  high  (.41,  lag=l;  and  .40,  lag=2),  con¬ 
firming  that  these  items  do  identify  perceived  characteristics  of  leaders 
from  successful  units.  However,  the  cross-lagged  correlations  going  in 
the  other  direction  (i.e.,  from  leadership  characteristics  to  Unit  Effec¬ 
tiveness)  are  much  lower  (.25,  lag=l;  and  .18,  lag=2) .  The  same  pattern 
can  be  seen  in  the  other  measures  related  to  Leadership  Climate,  although 
to  a  lesser  extent.  These  variables  (EM  Commitment,  Moral  Climate,  and 
Racial  Climate)  always  predict  Leadership  Climate  across  time  better  than 
Leadership  Climate  predicts  them.  This  finding  casts  some  doubt  on  the 
utility  of  using  perceived  leader  characteristics  to  predict  effectiveness, 
and  suggests  that  perceptions  of  leadership  climate  might  best  be  viewed 
as  a  result  of  unit  effectiveness  rather  than  a  cause. 


Integration  of  Record  Data  Measures  into  the  System  Model 

The  next  step  in  the  analysis  was  to  integrate  record  data  variables 
into  the  preliminary  system  model  created  from  the  macro  scales.  In  order 
to  do  this,  the  various  types  of  record  data  that  were  collected  were  ex¬ 
amined  to  identify  a  set  of  measures  which  seemed  relevant  to  the  concept 
of  unit  effectiveness  and  had  suitable  distributional  properties  for  sta¬ 
tistical  analysis.  Many  of  the  variables  examined  (such  as  Bars  to  Re-en¬ 
listment  and  Courts-Martial)  had  very  low  frequency  counts  resulting  in 
highly  skewed  distributions  and  many  scores  of  zero  which  made  them  un¬ 
usable.  The  result  of  this  screening  process  was  a  set  of  31  record  data 
measures, grouped  into  nine  content  categories  as  shown  in  Table  8.  Cross-lagged 


Probabilities  for  Rejection  of  the  Pattern  Hypothesis  that  the  Synchronous  and  Cross-Lagged  Correlations 


Since  dlscrlnlnatlon  indicators  calculated  on  small  samples  are  Inherently  unreliable  (Goehring,  Note  7),  data  for  this 
measure  was  aggregated  across  the  entire  30  weeks  of  the  study  and  a  single  correlation  coefficient  calculated  using  the 
wave  3  survey  data.  Therefore,  the  probabilities  shown  are  for  the  T  test  of  the  null  hypothesis  that  this  single  corre 
latlon  coefficient  equals  zero. 


comparisons  were  then  computed  between  the  various  record  data  measures  and 
the  macro  scales.  For  each  of  these  comparisons.  Table  8  presents  the  prob¬ 
abilities  for  rejection  of  the  null  hypothesis  that  the  synchronous  and 
cross-lagged  correlations  are  equal  to  zero.  In  an  earlier  study  which 
correlated  perceptual  measures  with  record  data  variables  (Boyd  &  Griesemer 
Note  6),  significant  correlations  were  found  which  averaged  approximately 
.20  in  a  sample  of  113  companies.  In  order  for  the  present  analysis  to  be 
sensitive  to  correlations  of  that  size  with  a  sample  of  only  60  companies, 
an  alpha  level  of  .10  was  used  as  the  significance  criterion  in  Table  8. 

One  very  basic  question  which  can  be  addressed  using  the  data  in  Table 
8  is  the  validity  of  the  perceptual  macro  measures.  In  order  to  be  consid¬ 
ered  valid  indicators  of  actual  unit  conditions,  the  macro  scales  should 
correlate  with  other  measures  of  unit  conditions  which  are  obtained  using 
different  methods,  such  as  record  data  variables.  In  Table  8  there  are 
210  possible  correlations  between  the  macro  scales  and  the  record  data 
measures.  Of  these,  54  or  26%  are  significant  beyond  the  .10  level,  which 
is  more  than  double  the  number  of  significant  relationships  which  would  be 
expected  by  chance.  This  finding  supports  the  validity  of  the  macro  scales 

In  order  to  identify  the  direction  of  the  various  relationships  identi¬ 
fied  in  Table  8,  the  average  cross-lagged  and  synchronous  correlations  were 
examined.  These  correlations  are  presented  in  Table  9  and  are  discussed 
below  by  record  data  variable  category. 

Record  data  unit  effectiveness  measures.  There  were  six  record  data 
variables  placed  in  this  category.  They  were:  number  of  Military  Police 
(MP)  reports;  number  of  AWOLs;  number  of  re-enlistments;  number  of  sick 
calls;  and  two  composite  variables  generated  from  special  Unit  Status  Re- 
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Table  9 

Synchronous  and  Cross-Lagged  Correlations  for  Significant 
Comparisons  Between  Record  Data  Measures  and  Macro  Scales2 


Record  Data  Macro 
Measures  (X)  Scale  (Y) 


Average 

Synchronous 

Correlations 

Lag=0 


Cross-lagged  Correlations 
Lag= 1  Lag=2 


Record  Data  Unit  Effectiveness  Indicators 


i 


Record  Data 
Measures  (X) 


Macro 

Scales 


00 


Average 

Synchronous 

Correlations 

Lag-0 


Cross-Lagged  Correlations 
Lag-1  Lag- 2 


Leader  Punishments 
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Table  9  -  Continued 

Synchronous  and  Cross-Lagged  Correlations  for  Significant 
Comparisons  Between  Record  Data  Measures  and  Macro  Scales0 


Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous 

Correlations 

Lag-0 


Enlisted  Turbulence 


Arrivals 

Moral  Climate 

.15 

X 

Leading 

Y 

Leading 

Time  in  Unit 
(E1-E4) 

Leadership  Climate 

-.26 

X 

Leading 

Y 

Leading 

EM  Commitment 

-.25 

X 

Leading 

Y 

Leading 

Moral  Climate 

-.20 

X 

Leading 

Y 

Leading 

Unit  Effectiveness 

-.17 

X 

Leading 

Y 

Leading 

Table  9  -  Continued 


Synchronous  and  Cross-Lagged  Correlations  for  Significant 
Comparisons  Between  Record  Data  Measures  and  Macro  Scales3 


Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous  Cross-Lagged  Correlations 

Correlations 

Lag-0  Lag-1  Lag-2 


Officer  &  NCO  Turbulence 


Time  in  Unit  Leadership  Climate 

X 

(01-03) 

.14 

Leading 

.23 

.40 

Y 

Leading 

.08 

-.13 

Racial  Climate 

X 

.21 

Leading 

.25 

.21 

Y 

Leading 

.25 

.08 

Moral  Climate 

X 

.19 

Leading 

.21 

.33 

Y 

Leading 

.07 

-.11 

Unit  Effectiveness 

X 

.22 

Leading 

.23 

.38 

Y 

Leading 

.09 

-.08 

Officer  Experience  &  Education 

Average 

Moral  Climate 

X 

Time  in 

.28  Leading 

.29 

.15 

Service 

Y 

Leading 

.27 

.19 

Cohesion 

X 

.  30  Leading 

.29 

.09 

Y 

Leading 

.32 

.27 

Unit  Effectiveness 

X 

. 35  Leading 

.39 

.27 

Y 

Leading 

.30 

.31 

Table  9  -  Continued 

Synchronous  and  Cross-Lagged  Correlations  for  Significant 
Comparisons  Between  Record  Data  Measures  and  Macro  Scales® 


Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous 

Correlations 

Lag«0 


Cross-Lagged  Correlations 
La  2*1  ijt 


Officer  Experience  &  Education 


Average  Time 
in  Service 
(01-03) 

Leadership  Climate 

.32 

X 

Leading 

Y 

Leading 

Racial  Climate 

.28 

X 

Leading 

Y 

Leading 

EM  Commitment 

.23 

X 

Leading 

Y 

Leading 

Average  Time 
in  Grade 
(01-03) 

Leadership  Climate 

.36 

X 

Leading 

Y 

Leading 

EM  Commitment 

.24 

X 

Leading 

Y 

Leading 

Moral  Climate 

.18 

X 

Leading 

Y 

Leading 

Unit  Effectiveness 

.35 

X 

Leading 

Y 

Leading 

Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous  Cross-Lagged  Correlations 

Correlations 

Lag*0  Lag=l  Lag* 2 


Years 

Civilian 

Education 

(01-03) 

Highest  . 

Military 

Education 

Level 

(01-03) 


Officer  Experience  &  Education 


Unit  Effectiveness 


Leadership  Climate 


Racial  Climate 


EM  Commitment 


Moral  Climate 


X 

.13  Leading 

Y 

Leading 

X 

•  30  Leading 

Y 

Leading 

X 

. 10  Leading 

Y 

Leading 

X 

. 18  Leading 

Y 

Leading 

X 

.27  Leading 

Y 

Leading 
X 

Leading 

Y 

Leading 


Unit  Effectiveness 


.24 


Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous  Cross-Lagged  Correlations 

Correlations 

Lag-0  Lag-1  Lag-2 


NCO  Experience  &  Education 


Average  Time 

Racial  Climate 

-.16 

X 

Leading 

in  Service 
(E5-E9) 

Y 

Leading 

Average  Time 

Racial  Climate 

X 

in  Grade 

-.12 

Leading 

(E5-E9) 

EM  Cohesion 

.04 

Y 

Leading 

X 

Leading 

Y 

Leading 

Enlisted  Education  &  Experience 


Average  GTAS 
(E1-E4) 

Leaders ip  Climate 

-.19 

X 

Leading 

Y 

Leading 

EM  Commitment 

-.32 

X 

Leading 

Y 

Leading 

EM  Cohesion 

.01 

X 

Leading 

Y 

Leading 

Record  Data 
Measures  (X) 


Macro 
Scales  (Y) 


Average 
Synchronous 
Correlations 
Lag»0 


Cross-Lagged  Correlations 

T.a  1  T  a  cr«  9 


Enlisted  Education  &  Experience 


Average 

Leader  Strictness 

X 

Time  in 

.12 

Leading 

Service 

Y 

CE1-E4) 

Leading 

Racial  Variables 


Discrimination 

Indicator 

(Promotions) 

Racial  Climate 

.24 

X 

Leading 

Y 

Leading 

EM  Cohesion 

.25 

X 

Leading 

Y 

Leading 

Discrimination 
Indicator 
(Article  15s) 

Leadership  Climate 

-.24 

X 

Leading 

Y 

Leading 

Racial  Climate 

-.23 

X 

Leading 

Y 

Leading 

Moral  Climate 

-.23 

X 

Leading 

Y 

Leading 

Unit  Effectiveness 

-.25 

X 

Leading 

Y 

Leading 

Record  Data  Macro 
Measures  (X)  Scales  (Y) 


Average 

Synchronous  Cross-Lagged  Correlations 

Correlations 

Lag=0  Lag“l  Lag* 2 


Racial  Variables 


X 

%  Minority  EM  Cohesion  -.16  Leading  -.09  .15 

Y 

Leading  -.27  -.34 


a.  n  *  59,  r  >_  .25  £  <  .05,  r  _>  .33  £  <  .01,  two  tailed. 

b.  Since  discrimination  indicators  calculated  on  small  samples  are  inherently 
unreliable  (Goehring,  Note  7) ,  data  for  this  measure  was  aggregated  across  the 
entire  30  weeRs  of  the  study  and  a  single  correlation  coefficient  calculated 
using  the  wave  3  survey  data.  Consequently,  cross- lagged  correlations  could 
not  be  calculated. 


port  (USR)  data  which  was  gathered  at  the  company  level.  In  order  to  con¬ 
trol  for  company  size  and  the  possibility  that  some  record  data  measures 
would  not  be  directly  comparable  across  divisions  because  of  differences 
in  local  administrative  procedures,  record  data  measures  involving  fre¬ 
quencies  (in  this  case  MP  reports,  AWOLs,  re-enlistments,  and  sick  calls) 
were  residualized  for  the  effect  of  company  size  and  post. 

The  two  USR  composites  were  developed  using  factor  and  item  analysis 
techniques  similar  to  those  used  to  develop  the  macro  scales.  The  first 
composite  (USR  I)  seems  to  represent  a  strength  dimension  and  consists  of 
six  elements:  the  operating  strength  percentage;  the  MOS  trained  percen¬ 
tage;  the  deployable  strength  percentage;  the  availability  of  qualified 
leaders  rating;  the  weeks  to  complete  training;  and  the  overall  unit  rating 
(see  Dept,  of  the  Army,  Note  8,  for  more  information  on  individual  USR 
items).  The  alpha  reliability  for  USR  I  was  .80.  USR  II  appears  to  rep¬ 
resent  a  logistics  dimension  and  consists  of:  the  availability  of  training 
areas/facilities  rating;  the  availability  of  fuel  rating;  the  availability 
of  time  rating;  and  the  availability  of  ammunition  rating.  USR  II  had  an 
alpha  coefficient  of  .72.  Neither  of  these  USR  measures  showed  any  sig¬ 
nificant  correlation  with  the  macro  scales,  nor  did  re- enlistments  or  sick 
calls.  On  the  other  hand,  MP  reports  and  AWOLs  did  show  a  number  of  signif 
cant  relationships.  As  might  be  expected,  most  of  these  correlations 
(shown  in  Table  9)  are  negative,  indicating  that  positive  perceptions  of 
unit  conditions  are  associated  with  fewer  MP  reports  and  AWOLs. 

An  interesting  characteristic  of  the  significant  MP  report  relation¬ 
ships  is  that  the  highest  correlations  occur  when  MP  reports  are  measured 
two  measurement  intervals  (approximately  5  months)  before  the  perceptual 
variables,  indicating  that  an  excessive  number  of  MP  reports  may  serve  as 
a  very  early  warning  of  deteriorating  unit  conditions.  AWOLs,  on  the  other 
hand,  show  a  somewhat  different  pattern  of  correlations  across  time.  For 


AWOLs,  the  highest  correlations  with  the  macro  scales  occur  after  one  meas¬ 
urement  interval  (10  weeks).  Also,  AWOLs  and  Moral  Climate  and  AWOLs  and 
Unit  Effectiveness  show  the  highest  correlation  when  the  macro  scale  leads 
AWOLs  in  time,  which  seems  to  suggest  that  negative  perceptions  of  the  unit 
will  be  followed  by  an  increase  in  the  number  of  AWOLs.  On  the  other  hand, 
AWOLs  and  EM  Cohesion  are  more  highly  correlated  when  AWOLs  lead  in  time, 
indicating  that  AWOLs  will  be  followed  by  reduced  perceptions  of  closeness 
among  the  enlisted  soldiers. 

Leader  Punishments.  Two  variables,  residualized  Article  15s  and  resid- 
ualized  Unprogrammed  Discharges  (UPD)  were  included  in  the  leader  punish¬ 
ment  category.  The  UPDs  included  only  "punitive"  discharges  such  as  Chap¬ 
ter  5  or  Chapter  13.  Medical  and  hardship  discharges  were  not  included. 
Article  15s  produced  four  significant  relationships  with  the  macro  scales. 
The  pattern  of  correlations  in  each  case  is  fairly  consistent.  The  corre¬ 
lations  are  generally  negative  with  the  highest  correlations  occurring  when 
Article  15s  are  measured  before  the  macro  scales.  The  correlations  are 
less  consistent  with  UPDs.  Leadership  Climate  and  EM  Commitment  show  gen¬ 
erally  negative  correlations  with  UPDs,  but  without  a  consistent  pattern 
of  cross-time  correlations.  Leader  Strictness,  on  the  other  hand,  shows  a 
positive  correlation  with  UPDs  and  roughly  equal  cross-time  correlations  re 
gardless  of  which  variable  is  leading.  Overall,  these  results  suggest  that 
Article  15s  and  UPDs  have  a  negative  impact  on  perceptions  of  the  unit,  al¬ 
though  the  pattern  of  correlations  with  UPDs  is  somewhat  inconsistent. 

Leader  Rewards.  Cross-lagged  comparisons  using  the  two  leader  reward 
variables.  Awards  and  Promotions,  produced  two  significant  comparisons, 
Promotions  with  Racial  Climate  and  Awards  with  Unit  Effectiveness.  In  the 
comparison  between  Promotions  and  Racial  Climate  the  two  5-month  correla- 


tions  are  the  strongest,  with  a  negative  sign  when  Promotions  lead  in  time 


and  a  positive  sign  when  Racial  Climate  leads  in  time.  This  sign  reversal 
may  indicate  a  negative  feedback  relationship  where  positive  racial  climate 
increases  the  number  of  promotions,  while  large  numbers  of  promotions  de¬ 
crease  racial  harmony.  This  latter  finding  may  indicate  that  minorities 
view  promotions  as  unfair  and  react  negatively  to  them.  Awards  showed 
weak  positive  correlations  with  Unit  Effectiveness  with  no  particular  time 
precedence. 

Enlisted  Turbulence.  There  were  four  significant  relationships  found 
when  measures  of  enlisted  turbulence  were  compared  with  the  macro  scales. 
Number  of  Arrivals  (residualized)  showed  a  weak  positive  relationship  with 
Moral  Climate,  while  Average  Time  in  Unit  showed  generally  negative  corre¬ 
lations  with  EM  Commitment,  Moral  Climate,  and  Unit  Effectiveness.  Since 
numerous  arrivals  indicate  high  turbulence  and  long  time  in  unit  indicates 
low  turbulence,  the  overall  pattern  of  results  indicates  that  enlisted  tur¬ 
bulence  (ie.,  high  rates  of  enlisted  turnover)  are  associated  with  more 
positive  perceptions  of  the  unit.  While  it  may  be  possible  that  low  enlis¬ 
ted  turnover  actually  produces  behavioral  changes  which  degrade  perceptions 
of  unit  effectiveness  (for  example  soldiers  entering  a  new  unit  may  initial¬ 
ly  be  on  their  "best  behavior"),  an  alternative  explanation  for  this  find¬ 
ing  is  that  the  longer  soldiers  are  in  a  unit  the  more  aware  they  become  of 
existing  unit  problems,  resulting  simply  in  a  change  of  perception  rather 
than  a  change  of  actual  behavior.  To  try  and  confirm  an  actual  behavioral 
change  as  a  result  of  enlisted  tur..  lence,  correlations  were  computed  be¬ 
tween  enlisted  Time  in  Unit  and  Article  15s,  AWOLs,  and  MP  reports.  None 
of  these  correlations  were  significant  so  the  hypothesis  of  an  actual  be¬ 
havioral  change  could  not  be  confirmed.  However,  this  should  not  be  con- 
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sidered  as  evidence  against  the  hypothesis  since  the  power  of  this  analysis 
is  unknown,  but  probably  fairly  low. 


Officer  &  NCO  turbulence.  Average  Time  in  Unit  scores,  calculated  sep¬ 
arately  for  grades  E5-E9  and  01-03,  were  used  as  measures  of  NCO  and  offic¬ 
er  turbulence.  While  there  were  no  significant  effects  of  NCO  turbulence, 
officer  Time  in  Unit  produced  generally  positive  correlations  with  Leader¬ 
ship  Climate,  Racial  Climate,  Moral  Climate,  and  Unit  Effectiveness.  The 
correlations  indicate  that  infrequent  rotation  of  officers  in  and  out  of 
units  is  advantageous  for  unit  effectiveness. 

Officer  experience  and  education  (01-03) .  All  four  of  the  record  data 
measures  used  in  this  category,  Years  Civilian  Education,  Highest  Military 
Education  Level,  Average  Time  in  Service,  and  Average  Time  in  Grade  pro¬ 
duced  at  least  one  significant  comparison  with  the  macro  scales  and  the 
strongest  of  these  variables.  Average  Time  in  Service,  correlated  with  all 
the  macro  scales  except  Strictness.  Overall,  this  category  of  variables 
has  the  highest  percentage  of  significant  relationships  of  any  of  the  cate¬ 
gories  examined  and  some  of  the  individual  correlational  coefficients  are 
fairly  large  (eg.,  .43  when  Average  Time  in  Service  leads  Leadership  Cli¬ 
mate),  indicating  that  officer  experience  is  a  very  potent  variable.  As 
might  be  expected,  the  correlations  in  this  group  are  almost  universally 
positive  indicating  that  officer  experience  is  associated  with  high  unit 
effectiveness.  There  are  at  least  two  possible  explanations  for  this 
finding:  one,  of  course,  being  that  officers  become  better  leaders  as  they 
gain  more  experience;  at  the  same  time,  it  may  also  be  tiue  that  poor  lead¬ 
ers  are  relieved  of  their  commands  before  they  have  very  much  tenure.  In 
actuality,  both  factors  are  probably  operating.  In  any  case,  the  implica¬ 
tions  of  this  finding  seem  to  be  that  an  experienced  leader  is  an  extreme- 


ly  valuable  resource,  and  that  steps  should  be  taken  to  insure  that  experi¬ 
enced  leaders  are  retained  in  the  service  where  their  skills  can  be  util¬ 


ized. 

NCO  experience  &  education  (E5-E9) .  The  NCO  experience  and  education 
measures  produced  a  different  pattern  of  results  than  the  corresponding 
officer  measures.  Only  three  significant  relationships  with  NCO  experience 
were  found.  Average  Time  in  Service  and  Average  Time  in  Grade  were  correla 
ted  with  Racial  Climate  and,  additionally,  Average  Time  in  Grade  was  corre¬ 
lated  with  EM  Cohesion.  The  pattern  of  these  correlations  is  such  that  the 
correlations  are  positive  when  the  NCO  experience  variable  leads  in  time, 
and  negative  when  the  perceptual  variable  leads  in  time.  This  pattern  is 
indicative  of  a  negative  feedback  relationship  in  which  NCO  experience  im¬ 
proves  perceptions  of  racial  climate  and  cohesion,  which  in  turn  tend  to 
lower  NCO  experience.  The  experience  of  a  unit's  NCOs  would  be  reduced  as 
the  experienced  NCOs  either  transfer  (PCS)  or  leave  the  service  (ETS) .  It 
may  be  possible  that  perceptions  of  racial  harmony  and  cohesion  cause  NCOs 
to  PCS  and/or  ETS,  although  the  reasons  this  might  occur  are  not  apparent. 

Enlisted  education  &  experience  (E1-E4).  Three  variables  were  construe 
ted  to  measure  enlisted  experience  and  education  (in  grades  E1-E4).  They 
were:  Years  Civilian  Education;  average  General  Technical  Aptitude  Score 
(GTAS);  and  Average  Time  in  Service.  GTAS  score  was  significantly  corre¬ 
lated  with  Leadership  Climate,  EM  Commitment,  and  EM  Cohesion.  Correla¬ 
tions  in  this  group  with  GTAS  leading  in  time  were  generally  negative. 
Correlations  with  a  macro  scale  leading  in  time  were  also  negative  (but 
quite  low)  for  Leadership  Climate  and  EM  Commitment,  but  positive  and  some¬ 
what  higher  when  EM  Cohesion  was  leading.  Apparently  units  with  high  GTAS 
scores  tend  to  have  negative  perceptions  of  the  unit,  while  perceptions 


of  cohesion  tend  to  be  associated  with  increased  GTAS  scores. 

The  other  significant  comparison  in  this  group,  between  Average  Time 
in  Grade  and  Leader  Strictness,  showed  relatively  weak  positive  correla¬ 
tions  which  were  approximately  equal  with  either  variable  measured  first 
in  time. 

Racial  variables .  Three  racial  variables  were  computed  and  compared 
with  the  macro  scales.  They  were:  the  Percent  Minority  Personnel  in  the 
Unit;  a  "discrimination  indicator"  for  promotions;  and  a  "discrimination  indi 
cator"  for  Article  15s.  The  "discrimination  indicator"  (DI)  is  an  index 
which  compares  the  actual  number  of  blacks  or  minority  individuals  in  a 
category  or  group  with  the  number  of  individuals  which  could  be  expected 
in  the  group,  if  race  was  unrelated  to  group  membership.  If  the  actual 
number  of  individuals  is  approximately  equal  to  the  expected  number,  the 
DI  will  be  near  zero.  If  there  are  more  minority  individuals  in  the  group 
than  expected,  the  DI  becomes  positive,  if  there  are  less  minority 
individuals  than  expected,  the  DI  becomes  negative  (Dept,  of  the  Army, 

Note  9;  Nordlie,  Thomas,  &  Sevilla,  Note  15). 

Both  Article  15  and  Promotion  DIs  produced  significant  correlations 
with  the  macro  scales.  Correlations  with  the  Promotion  DIs  were  positive 
while  correlations  with  the  Article  15  DIs  were  negative.  Units  where  blacks 
receive  less  than  their  share  of  promotions  would  have  positive  DIs.  Units 
where  blacks  receive  more  than  there  share  of  Article  15s  would  have  negative 
DIs.  Therefore,  both  the  positive  correlation  with  the  Promotion  DI  and  the 
negative  correlation  with  the  Article  15  DI  Indicate  that  Institutional 
discrimination  has  a  negative  impact  on  perceptions  of  unit  effec- 


tiveness . 


The  percent  minority  individuals  in  a  unit  produced  a  single  signifi¬ 
cant  relationship  with  EM  Cohesion.  Most  of  the  correlations  in  the  cross 
lagged  comparison  were  negative,  indicating  that  a  high  percentage  of  mi¬ 
nority  individuals  in  a  unit  is  associated  with  reduced  feelings  of  close¬ 
ness  among  the  enlisted  soldiers. 

Summary  of  Record  Data-Macro  Scale  Comparisons 

The  major  trends  in  the  data  observed  when  the  macro  scales  were  com¬ 
pared  with  the  record  data  measures  included  a  strong  positive  effect  of 
officer  experience  and  a  somewhat  weaker  positive  effect  of  enlisted  tur¬ 
bulence.  The  major  negative  impacts  on  perceptions  of  the  unit  were  of¬ 
ficer  turbulence.  Article  15s,  AWOLs,  MP  Reports,  and  Discrimination 
Indicators.  The  effects  of  two  variables,  NCO  Experience  and  Un¬ 
programmed  Discharges,  were  ambiguous  and  difficult  to  interpret. 

Finally,  it  is  interesting  to  note  that  a  number  of  variables,  which 
are  often  officially  monitored  by  the  Army,  showed  little  or  no 
correlation  with  perceptions  of  unit  conditions.  These  variables 
include  Awards,  Re-enlistments,  and  Unit  Status  Reports. 

System  Model 

Figure  4  shows  the  integration  of  the  major  relationships  between  the 
record  data  measures  and  macro  scales  into  the  system  model.  Since  the 
macro  scales  are  highly  intercorrelated,  and  since  particular  record  data 
variables  generally  correlated  in  the  same  direction  with  several  of  the 
macro  scales,  the  scales  are  shown  in  the  figure  grouped  as  a  single  entry 
labeled  "Perceptions  of  the  Unit."  The  primary  record  data  impacts  on 
perceptions  of  the  unit  are  shown  in  the  boxes  to  the  left.  Record  data 
variables  in  these  boxes  are  labeled  "General  Effects"  because  they  corre- 


50 


iV»V^.yV-V.VJ', 


*-*  ~ J  »  3 U i.  r  ' . '  ' 


lated  with  more  than  one  macro  scale.  Since  these  variables  are  general 
effects,  their  path  arrows  are  shown  as  impacting  on  perceptions  of  the 
unit  as  a  whole.  The  sign  on  the  path  arrows  indicates  the  direction  of 
the  relationship  as  determined  by  the  predominant  sign  of  the  individual 
correlation  coefficients. 

Besides  the  general  effects,  there  were  several  record  data  variables 
which  correlated  with  a  single  macro  scale.  These  variables  are  shown  at 
the  top  of  the  model  and  are  labeled  "Specific  Effects."  Path  arrows  for 
these  variables  point  directly  to  the  macro  scale  with  which  they  were 


correlated. 


Discussion 


The  system  model  shown  in  Figure  4  is  somewhat  unsatisfying  for  a  number 
of  reasons.  Most  obvious  of  these  is  its  lack  of  detail,  both  in  terms  of 
specific  relationships  between  variables  and  the  lack  of  some  sort  of  path 
coefficients  to  estimate  the  magnitude  of  the  effects.  However,  as  discussed 
previously,  there  is  currently  no  satisfactory  method  for  estimating  meaning¬ 
ful  path  coefficients  for  a  detailed  cross-time  model  from  the  data  available 
in  this  study.  Also,  while  the  model  in  Figure  4  is  quite  general,  it  does 
contain  13  major  constructs,  many  of  which  are  themselves  composite  variables. 

To  go  beyond  the  13  basic  constructs  in  Figure  4  in  an  attempt  to  substantially 
interpret  all  the  relationships  between  the  individual  variables  would  be  asking 
a  lot  of  the  data,  given  the  relatively  small  sample  size  and  the  instability 
of  cross-lagged  correlations  demonstrated  in  Appendix  B. 

However,  despite  its  limitations,  the  system  model  in  Figure  4  does 
suggest  some  interesting  relationships  which  seem  to  have  important  implica¬ 
tions  for  the  Army  and,  which  could  be  examined  in  more  detail  in  subsequent 
studies. 

Factor  Structure  of  the  Macro  Scales 

One  area  of  interest  in  the  model  in  Figure  4  is  the  nature  of  the 
macro  scales;  both  in  terms  of  their  factor  structure  and  assumptions  about 
what  they  actually  measure.  There  is  a  fair  amount  of  disagreement  about  what 
an  individual's  perceptions  of  his  environment  actually  measure.  On  one  end 
of  a  continuum,  Bowers  and  Seashorne  (1966),  working  in  the  area  of  leadership 
climate,  argue  that  perceptions  are  primarily  descriptive  and  are  no  different 
from  any  other  method  of  quantifying  behavior,  since  "all  involve  the  measure¬ 
ment  of  behavior  by  some  person  or  machanism"  (p.261).  On  the  opposite  pole. 


Guion  (1973)  argues  that  perceptions  cannot  be  considered  a  description  of 
objective  reality,  and  that  perceptions  of  organizational  climate  (of  which 
Bowers  and  Seashome's  leadership  measures  could  be  considered  a  part)  are, 
in  fact,  largely  mediated  by  an  individual's  satisfaction  with  his  environment. 
Thus,  rather  than  being  descriptive,  Guion  considers  perceptions  basically  an 
affective,  nondescriptive  variable.  Taking  the  middle  ground,  Jones  and  James 
(Note  10)  maintain  a  distinction  between  perceptual/cognitive  representations 
of  a  situation  and  affective,  evaluative  reactions  to  that  situation.  Although 
they  acknowledge  that  the  two  concepts  are  often  closely  related,  they  maintain 
that  perceptions  of  behavior  (and  other  environmental)  stimuli  are  primarily 
descriptive. 

Examining  the  evidence  from  the  present  study,  the  contrast  between  the 
conceptual  dissimilarity  of  the  various  macro  scales  and  the  high  degree  of 
inter correlation  between  them  suggests  that  there  is  a  pervasive  underlying 
variable  which  unites  these  apparently  different  perceptual  measures.  Guion 's 
concept  of  satisfaction  would  seem  to  be  a  likely  candidate  for  this  under¬ 
lying  variable.  Unfortunately,  the  data  collected  for  the  present  study  does 
not  provide  a  direct  measure  of  satisfaction  with  which  to  test  this  hypothesis. 
Some  additional  circumstantial  evidence  for  the  proposition  that  the  perceptual 
measures  used  in  this  study  are  somewhat  less  than  objective  descriptions  of 
reality  come  from  the  generally  low  correlations  between  the  objective  record 
data  variables  and  the  perceptual  macro  scales  which  were  found  in  this  and 
other  similar  studies  (Jones  and  James,  Note  10;  Boyd  &  Griesemer,  Note  6). 

Despite  these  considerations,  the  fact  that  correlations  exist  at  all 
between  perceptual  and  objective  measures  suggests  that  perceptual  measures  do 
have  some  utility  as  descriptive  measures.  However,  whatever  descriptive  pro¬ 
perties  the  measures  may  possess  are  undoubtedly  mediated  through  a  complex  set 


of  intervening  variables  which  may  include  such  things  as  the  observer's  ^ 

frame  of  reference,  his  pre-existing  cognitive  structures,  his  satisfaction  , 

with  his  general  situation,  etc. 

Even  if  perceptual  measures  are  not  primarily  descriptive  they  still  may  ] 

J 

be  useful.  An  assumption  which  is  commonly  made,  and  which  appears  quite  , 

reasonable,  is  that  individuals  will  act  on  their  perceptions,  which  makes 

( 

« 

perceptual  measures  useful  for  predicting  future  behavior.  Also,  as  Jones 
and  James  point  out,  perceptual  measures  of  organizational  climate  tend 
to  reflect  the  organizational  influences  which  are  psychologically  important  to 

the  individuals  in  the  situation.  In  the  present  study  this  means  that  the  var-  i 

< 

ious  factors  recovered  in  the  factor  analysis  represent  concepts  which  are  salient 
for  the  enlisted  soldiers  who  comprise  the  majority  of  respondents.  As  such, 

J 

they  represent  areas  which  will  probably  have  to  be  addressed  in  any  attempt  to 
change  or  monitor  the  organizational  effectiveness  of  an  infantry  unit. 

The  concept  of  organizational  climate  factors  as  psychologically  important 

I 

variables  is  also  relevant  to  the  appearance  of  the  racial  and  moral  climate  ! 

factors  in  the  present  model.  Variables  such  as  these  usually  do  not  appear  j 

in  organizational  climate  models,  possibly  because  they  have  little  relevance  | 

to  the  business  and  industrial  settings  in  which  these  models  are  usually 

applied.  Originally  the  items  comprising  these  two  unusual  factors  were  included 

in  the  present  study  because  enlisted  soldiers  had  expressed  concerns  about 

these  areas  to  the  researchers  during  pilot  interviews.  The  fact  that  these 

areas  appeared  as  factors  and  correlated  highly  with  more  traditional  measures 

of  organizational  climate  indicates  that  they  should  be  included  in  future 

research  on  organizational  climate  in  Army  infantry  units,  and  that  these  areas 

will  have  to  be  of  concern  to  anyone  who  is  attempting  to  improve  the  performance 

of  Infantry  soldiers. 


56 


Personnel  Turbulence 


The  issue  of  personnel  turbulence  in  the  Army  has  two  related  aspects, 
one  is  the  actual  transfer  of  personnel  from  unit  to  unit  and  place  to 
place,  while  the  other  is  the  retention  of  experienced  personnel  in  the 
service.  The  results  of  the  present  study  have  implications  for  both  as¬ 
pects. 

In  regard  to  personnel  transfers,  the  finding  of  a  different  valence 
for  the  effect  of  officer  and  enlisted  turbulence  is  interesting.  Turn¬ 
over  among  the  officers  had  a  negative  effect  on  perceptions  of  the  unit 
while  turnover  in  grades  E1-E4  had  a  positive  effect.  This  finding  has 
implications  for  the  Army's  plan  to  experiment  with  a  regimental  system 
of  assignment  in  which  a  soldier  would  remain  with  a  unit  from  the  time 
he  graduated  from  basic  training  until  he  left  the  service.  In  the  pres¬ 
ent  study,  the  average  time  in  unit  for  officers  was  a  relatively  short 
265  days,  with  a  maximum  of  552  days.  These  figures  indicate  that  the 
Army's  recent  policy  decision  to  increase  the  tour  of  company  commanders 
from  12  to  18  months  (which  was  initiated  after  the  data  for  the  present 
study  was  collected)  can  be  expected  to  increase  perceptions  of  unit 
effectiveness.  For  enlisted  soldiers  the  average  time  in  unit  was  367 
days  or  roughly  one  year,  while  the  maximum  was  513  days  or  1.4  years. 

The  finding  that  an  average  E1-E4  time  in  unit  as  short  as  1.4  years  can 
produce  measurable  decrements  in  perceptions  of  effectiveness  indicates 
the  army  may  experience  problems  with  the  enlisted  soldiers  as  it  imple¬ 
ments  the  regimental  system. 

The  regimental  system  reportedly  has  worked  well  for  the  British  Army 
but  their  success  with  the  system  may  be  due  to  factors  other  than  just 


the  length  of  time  soldiers  remain  in  the  unit.  For  example,  to  help 
maintain  cohesion  and  unit  identity  soldiers  in  British  regiments  often 
wear  distinctive  insignia  on  their  uniforms,  use  their  own  unique  rank 
titles,  and  carefully  maintain  unit  traditions  and  customs.  Another  im¬ 
portant  factor  may  be  the  availability  of  recreational  opportunities. 
Recreation  may  take  on  additional  importance  in  the  regimental  system 
because  of  the  lack  of  novelty  resulting  from  longer  tours  of  duty. 

Since  the  present  study  suggests  that  simply  lengthening  the  time  a  sol¬ 
dier  spends  in  a  unit  will  decrease,  rather  then  increase,  effectiveness 
the  Army  may  have  to  place  strong  emphasis  on  factors  such  as  thos,e  dis¬ 
cussed  above  in  order  to  make  the  regimental  s.ys.tem  a  success. 

The  other  important  aspect  of  the  turbulence  issue  is  the  retention  of 
experienced  personnel.  It  is  generally  agreed  that  increasing  the  reten¬ 
tion  of  qualified  personnel  is  a  major  priority  in  the  Army.  The  strong 
correlations  between  the  officer  experience  variables  and  the  perceptions 
of  unit  effectiveness  attest  to  the  appropriateness  of  this  priority. 

Also  relevant  in  this  regard  is  the  finding  of  a  negative  correlation 
between  General  Technical  Aptitude  Scores  (GTAS)  and  perceptions  of  unit 
effectiveness.  Initially  this  finding  seems  to  indicate  that  units  with 
predominantly  high  GTAS  personnel  are  less  effective.  However,  an  alter¬ 
native  interpretation,  which  may  be  more  reasonable  in  this  case,  is  that 
high  GTAS  soldiers  are  less  satisfied  with  conditions  in  their  unit,  and 
therefore,  have  more  negative  perceptions  of  them.  If  this  were  true  it 
might  be  expected  that  high  GTAS  soldiers  would  leave  the  service  sooner 
than  low  GTAS  soldiers.  In  fact,  the  results  of  a  preliminary  ARI  study 
which  examined  retention  rates  found  that  soldiers  with  high  mental  abil- 
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ity  test  scores  on  Army  entrance  exams  (which  are  highly  correlated  with 
GTAS  scores)  leave  the  Army  at  a  much  higher  rate  than  soldiers  with  low 
mental  ability  (Goehring,  Note  11). 

If  the  negative  correlation  between  GTAS  and  perceptions  of  the  unit 
does  indeed  represent  dissatisfaction  among  the  most  technically  compe¬ 
tent  individuals  it  could  be  a  serious  problem  for  the  Army.  It  is  exact 
ly  these  individuals  who  will  be  in  the  greatest  demand  as  Army  weapons 
systems  continue  to  become  more  technologically  sophisticated. 

Article  15s  and  Promotions 

These  two  variables  are  grouped  together  because  they  both  represent 
ways  in  which  a  company  commander  intervenes  administratively  to  control 
his  unit,  and  because  both  variables  were  correlated  negatively  across 
time  with  perceptions  of  unit  effectiveness.  Article  15s  correlated  nega¬ 
tively  with  four  of  the  macro  scales,  while  promotions  correlated  nega¬ 
tively  with  racial  climate. 

It's  not  too  surprising  that  Article  15s  correlate  negatively  with 
unit  perceptions  but  the  finding  that  promotions  can  have  a  negative  im¬ 
pact  on  promotions  occurs  with  racial  climate,  it  may  be  that  minorities 
view  promotions  as  unfair  and  react  negatively  to  them.  Examination  of 
the  means  for  a  number  of  individual  survey  items  indicates  that  a  large 
percentage  of  individuals  do  believe  that  promotions  are  unfair.  The  en¬ 
listed  respondents  estimated  that  only  44%  of  their  peers  agree  with  unit 
leaders  about  who  should  be  promoted,  while  42%  said  that  company  leaders 
tend  to  promote  the  least  intelligent  individuals. 

To  attempt  to  determine  if  there  was  any  objective  basis  to  these  nega¬ 
tive  perceptions  of  the  promotions  system,  an  overall  DI  for  promotions 


was  calculated  by  aggregating  data  across  all  60  units  In  the  sample.  The 
overall  DIs  were  fairly  close  to  zero  (5.69  for  blacks,  and  -5.68  for 
whites),  indicating  that,  overall  blacks  and  whites  receive  promotions 
roughly  in  proportion  to  their  racial  distribution.  By  this  criterion  at 
lease,  the  promotion  system  can  be  considered  fair,  and  thus  cannot  account 
for  the  negative  overall  correlations  between  promotions  and  racial  climate. 
(Although  when  institutional  discrimination  in  promotions  actually  does 
exist  it  will  impact  negatively  on  the  racial  climate  as  was  shown  by  the 
correlations  between  company  level  DIs  and  racial  harmony,  which  was  first 
presented  in  Table  9).  One  possible  explanation  for  the  negative  overall 
correlations  between  promotions  and  racial  climate  in  the  absence  of  any 
overall  pattern  of  discrimination  in  this  sample  is  what  might  be  called 
a  negative  halo  effect.  Blacks  may  have  the  expectation  that  promotions  are 
discriminatory  even  when  they  are  not.  The  negative  set  may  well  come  from 
historical  patterns  of  discrimination  against  blacks  in  the  Army  (Depart¬ 
ment  of  the  Army,  Note  9).  For  example,  while  the  overall  DI  for  promotions 
was  5.69,  a  third  of  the  individual  units  in  the  sample  had  DIs  less  than 
-30,  which  indicates  a  fairly  large  under-representation  of  black  promotions 
in  these  units* 

Like  promotions,  punishment  in  the  units  surveyed  was  considered  un¬ 
fair  by  a  large  number  of  respondents.  Soldiers  in  grades  E1-E4  esti¬ 
mated  that  only  38Z  of  their  peers  agreed  with  unit  leaders  about  who  de¬ 
serves  to  be  punished,  and  54Z  stated  that  company  leaders  very  frequently 
punished  Innocent  enlisted  soldiers.  With  such  a  high  percentage  of  the 


enlisted  soldiers  believing  that  punishment  is  unfair,  it  is  not  surpris¬ 
ing  that  high  numbers  of  Article  15  punishments  are  associated  with  more 
negative  perceptions  of  the  unit  by  the  enlisted  soldiers. 

One  reason  that  enlisted  soldiers  view  punishment  as  unfair  is  that 
there  is  a  large  discrepency  between  the  perceived  offense  rate  and  the 
perceived  punishment  rate.  When  asked  what  percent  of  the  enlisted  sol¬ 
diers  in  the  unit  broke  rules  or  laws  for  which  they  could  reasonably  be 
punished,  the  El-  E4s  estimated  that  an  average  of  51%  broke  rules  or  laws. 
However,  when  asked  about  the  punishment  rate,  only  17%  of  the  El-E4s  re¬ 
ported  that  they  had  actually  been  punished  by  the  unit  leaders.  Unit 
leaders  (CO  &  1SG)  on  the  other  hand,  estimated  that  24%  of  the  enlisted 
soldiers  in  their  units  broke  rules  for  which  they  could  reasonably  be 
punished.  The  closeness  of  the  leaders'  estimate  of  lawbreaking  and  the 
enlisted  reports  of  punishment  indicate  that  unit  leaders  are  punishing 
subordinates  roughly  in  line  with  their  own  perceptions  of  the  amount  of 
lawbreaking.  However,  unit  leaders  cannot  be  everywhere  and  see  every¬ 
thing,  and  of  course  subordinates  are  likely  to  hide  actions  which  will 
result  in  punishment.  Therefore,  unit  leaders  are  probably  unaware  of 
much  of  the  rule  and  law  breaking  that  goes  on  in  their  units.  The  re¬ 
sulting  low  level  of  punishment  may  interact  with  the  high  perceived  of¬ 
fense  rate  among  the  enlisted  soldiers  to  produce  feelings  of  injustice 
in  those  few  offenders  who  were  "unlucky"  enough  to  be  caught  and  punished. 

A  second  factor  which  may  produce  feelings  of  unfairness  about  punishment 
and  discipline  is  perceived  racial  or  other  bias  in  the  application  of  punish 
ment.  There  is  evidence  that,  in  many  cases,  racial  factors  are  related  to 
punishment  and  discipline.  For  example.  Figure  5  presents  the  overall 


Discrimination  Indicators  comparing  black  offense  rates  to  black  punishment  rates 


Reports 


discrimination  indicators  for  two  measures  of  punishment  rates:  total 


Article  15s,  and  Article  15s  for  AWOL;  and  two  measures  of  offense  rates: 
MP  reports,  and  AWOLs  as  reported  by  SIDPERS  DYST  (duty  status)  transac¬ 
tions.  The  left  side  of  Figure  5  shows  that  blacks  are  highly  overrepre¬ 
sented  in  terms  of  the  number  of  Article  15s  they  receive.  Of  course,  it 
might  be  argued  that  blacks  commit  more  offenses  than  other  racial  groups 
and,  therefore,  receive  more  punishments.  However,  examination  of  the 
two  offense  rate  measures  presented  in  Figure  5  provide  little  evidence 
for  this  proposition.  The  figure  shows  that  blacks  are  slightly  overrepre¬ 
sented  in  the  number  of  times  they  are  the  subject  of  MP  reports,  but 
that  this  overrepresentation  is  less  than  the  overrepresentation  found  in 
total  Article  15  punishments.  The  second  offense  rate  DI,  AWOLs,  shows 
that  blacks  are  actually  underrepresented  on  this  dimension  (i.e.,  they 
go  AWOL  at  a  rate  lower  than  whites),  yet  they  still  received  far  more 
than  their  expected  number  of  Article  15s  for  AWOLs.  Given  this  apparent 
imbalance  between  offense  rates  and  punishments,  it  is  not  surprising 
that  enlisted  soldiers  view  punishment  and  discipline  as  unfair,  and 
that  the  issuance  of  a  large  number  of  Article  15s  is  associated  with 
more  negative  perceptions  of  the  unit. 

Strength  and  Generality  of  the  Relationships 

A  number  of  findings  in  this  study  could  have  important  implications 
for  the  Army.  For  example,  the  findings  on  turbulence,  GTAS  scores,  and 
officer  experience  may  be  of  interest  to  policy  analysts.  The  findings 
on  Article  15s,  AWOLS,  MP  reports  and  racial  discrimination  could  be 
useful  to  unit  commanders  in  performing  their  leadership  and  personnel 
management  tasks.  However,  the  correlations  on  which  these  findings  are 


based,  while  statistically  significant,  are  not  especially  strong.  Typic¬ 
ally  they  are  in  the  .25  to  .35  range  and  account  for  only  5  to  12%  of  the 
variance . 

Whether  relationships  of  this  size  are  important  or  not  is  determined 
primarily  by  the  importance  attached  to  the  particular  variables  involved 
and  is,  therefore,  a  policy  issue  as  much  as  a  research  issue.  The  prob¬ 
lem  is  complicated  by  the  fact  that  correlation  coefficients  will  always 
under-estimate  the  true  variance  accounted  for  in  a  relationship  because 
measures  are  never  perfectly  reliable,  and  by  the  fact  that  a  policy 
change  based  on  such  a  finding  will  never  perfectly  manipulate  a  variable 
when  it  is  applied  in  the  field.  These  factors  combine  to  make  the  size  of 
the  correlation  between  two  variables  a  relatively  poor  measure  of  the 
true  strength  of  a  relationship.  Probably  the  best  way  to  determine 
the  importance  of  any  particular  finding  is  by  implementing  a  carefully 
controlled  evaluation  study  in  the  field.  However  the  relatively  high 
cost  of  such  studies  make  them  feasible  only  for  areas  of  high  priority 
and/or  large  potential  benefits. 

An  additional  factor  which  must  be  considered  along  with  these  find¬ 
ings  is  the  fact  many  of  the  results  are  based  on  the  relatively  new  tech¬ 
nique  of  examining  cross-time  correlations.  As  Appendix  B  illustrates 
cross- time  correlation  can  behave  in  unusual  and  counter  intuitive  ways. 

An  extremely  valuable  step  in  accessing  the  validity  of  cross-time  corre¬ 
lation  analysis  would  be  to  attempt  replicate  findings  such  as  the  ones 
in  the  report  in  the  context  of  an  experimental  design.  Such  a  study 
has,  to  the  best  of  this  author’s  knowledge,  never  been  attempted. 

The  generality  of  the  findings  in  this  report  is  another  issue  which 


must  be  considered.  This  research  was  done  on  a  relatively  small  sample 
of  combat  line  companies  but  at  least  some  of  these  results  have  been  rep¬ 
licated  in  other  studies  using  combat  units  (eg.  the  Article  15  and  MP  re¬ 
port  findings  which  are  similar  to  those  of  Hart(1978)  ).  This  fact,  and 
the  fact  that  the  data  from  the  present  study  was  collected  from  two  sep¬ 
arate  and  geographically  distant  divisions,  suggests  that  generalization 
to  other  combat  line  units  is  appropriate.  It  is  unknown  whether  the  re¬ 
sults  would  generalize  to  combat  support  units  or  other  types  of  units  with 
more  technical  or  administrative  missions. 


HYPOTHESES  RELEVANT  TO  THE  DEVELOPMENT  OF  A 
UNIT  PERSONNEL  MANAGEMENT  MONITORING  SYSTEM 

One  possible  application  of  the  information  from  the  preceding  system 
modeling  effort  is  the  development  of  a  unit  personnel  management  monitoring 
system.  This  system  would  provide  commanders  with  a  tool  for  diagnosing  con¬ 
ditions  in  their  units  which  have  been  shown  to  cause  reduced  unit  effectiveness 

The  need  for  such  a  system  is  illustrated  by  the  correlations  presented 
in  Table  10.  Table  10  shows  intra-group  correlations  for  13  survey  scales 
which  were  used  as  components  of  the  macro  scales.  The  left  most  column 
presents  significant  correlations  between  black  and  white  enlisted  respondents 
(E1-E4),  followed  by  correlations  between  all  El-E4s  and  the  CO  in  the  second 
column,  all  El-E4s  and  the  1SG  in  the  third  column,  and  between  the  CO  and  1SG 
in  the  fourth  column.  The  correlations  indicate  that  while  there  is  at  least 
a  moderate  consensus  between  black  and  white  enlisted  respondents,  there  is 
very  little  agreement  between  the  enlisted  soldiers  and  the  CO  and  1SG,  or 
even  between  the  CO  and  1SG  regarding  attitudes  toward  and  perceptions  of 
unit  conditions.  This  lack  of  consensus  between  unit  leaders  and  subordinates 
can  cause  difficulties.  Individuals  tend  to  act  on  the  basis  of  their  per¬ 
ceptions,  and  thus,  to  fully  understand  their  troops,  leaders  must  understand 
and  be  aware  of  the  way  they  perceive  their  environment. 

The  relationships  presented  in  the  system  model  provide  a  number  of  hy¬ 
potheses  relevant  to  a  unit  personnel  management  monitoring  system.  On  a 
general  level,  the  study  indicated  that  negative  perceptions  of  the  concept 
areas  represented  by  the  macro  scales,  such  as  EM  Commitment,  Cohesion,  Moral 
Climate,  Leadership  Climate,  and  Racial  Climate  were  correlated  with  both  face 


Table  10 


Significant  Scale  Correlations  Between  Respondent  Groups 


Respondent  Group 


Scale 


Black  &  White 
E1-E4 


Total  E1-E4 
&  CO 


Total  E1-E4 
&  1SG 


Total  Number  of 
Significant  Correlations 


3 


2 


3 


valid  perceptions  of  unit  effectiveness  and  with  objective  record  data  indi¬ 
cators  of  effectiveness.  Therefore,  one  approach  to  a  unit  personnel  manage¬ 
ment  monitoring  system  would  be  to  design  a  short  survey  around  the  major  per¬ 
ceptual  factors  which  were  isolated  in  the  study.  An  attempt  to  select  items 
for  such  a  survey  is  shown  in  Table  11.  To  construct  Table  11,  item-total 
correlations  were  calculated  between  the  company  level  macro  scale  scores  used 
in  the  system  modeling  and  the  company  level  means  for  each  individual  item 
included  in  the  scales.  To  reduce  the  number  of  items  required  for  the  monitor¬ 
ing  survey,  a  subset  of  items  was  chosen  for  each  of  the  seven  macro  scales 
which  would  maximize  both  the  internal  consistency  of  the  indices  and  their 
independence.  To  accomplish  this,  the  items  for  each  index  with  the  highest 
item-total  correlation  were  selected  (up  to  a  maximum  of  10  items  per  index) 
but  only  if  the  correlation  between  the  item  and  its  own  index  was  at  least 
.20  greater  than  between  the  item  and  all  the  other  Indices.  (No  items  met 
the  criterion  for  inclusion  into  the  EM  Commitment  index  so  it  was  not  included 
in  the  table.) 

Examination  of  the  items  in  Table  11  reveals  that  there  would  be 
substantial  practical  problems  incorporating  them  into  a  survey  to  be  used  by 
the  company  commander.  For  example,  many  leaders  are  offended  by  the  idea  of 
being  rated  by  their  subordinates,  which  is  essentially  what  the  enlisted  sold¬ 
iers  would  be  doing  in  filling  out  the  Leadership  Climate  and  Strictness  items. 

The  enlisted  soldiers  in  turn,  are  likely  to  react  negatively  to  the  Moral 
Climate  items,  which  to  a  large  extent  would  be  self  incriminating.  Elimina¬ 
tion  of  these  areas  would  leave  Unit  Effectiveness,  Cohesion,  and  Racial  Cli¬ 
mate,  however,  other  survey  instruments  which  deal  with  these  areas  have  already 
been  developed  (for  example,  the  TDAS,  Brown,  Note  12;  and  the  GOQ ,  Organizational 


Table  11 


Correlations  of  Questionnaire  Items  with  Macro  Scales 
for  Items  Which  Met  Criteria  for  Inclusion  on  Monitoring  Survey 

Item  Total  Correlation _ Item  Description _ 

Leadership  Climate 

Are  CO  &  1SG  willing  to  risk  poor  OER/EER  to 
protect  EMs  from  unfair  demands 

EMs  agree  about  who  deserves  punishment 

CO  emphasizes  policy  of  treating  all  fairly 
and  equally 

EMs  treated  in  a  positive  way  no  matter  what 
they  have  done 

EMs  feel  like  protesting  the  actions  of  their 
leaders 

Company  leaders  treat  group  members  as  equals 
Leaders  treat  all  fairly  and  justly 
EMs  rate  CO 

Leaders  put  suggestions  made  by  group  into 
operation 

Leaders  punish  innocent  enlisted  soldiers 


Unit  Effectiveness 


.76 

%  group  members  trusted  in  battle 

.76 

Willingness  to  fight 

.72 

Are  equipment  &  resources  adequate,  efficient, 
and  well  maintained. 

.72 

Members  of  unit  do  high  quality  work 

.74 

Company  generally  quick  to  use  improved  work 
methods 

.80 

.82 

.79 

.77 

.78 

.75 

.82 

.74 

.72 

.70 


Table  11  -  Continued 


Correlations  of  Questionnaire  Items  with  Macro  Scales 
for  Items  Which  Met  Criteria  for  Inclusion  on  Monitoring  Survey 


Item  Total  Correlation 

Item  Description 

Cohesion 

.93 

EMs  close  during  past  8  weeks 

.91 

EMs  distant  during  past  8  weeks 

Strictness 

.86 

Company  leaders  require  respect  for  authority 
at  all  times 

.89 

Company  leaders  establish  strict  rules  against 
disobedience 

Moral  Climate 

.58 

Illegal  activities 

.65 

Making  company  weak  and  ineffective 

.57 

White  EMs  who  talked  about  forming  allr-white  groups 

.68 

Breaking  rules  on  purpose  to  get  out  of  Army 

.64 

Selling  pot 

.43 

Smoking  pot 

.68 

Breaking  as  many  rules  and  regulations  as 
possible  without  getting  caught 

.63 

Seriously  violating  the  law 

.59 

Showing  respect  for  the  law 

Racial  Climate 


Table  11  -  Continued 


Correlations  of  Questionnaire  Items  with  Macro  Scales 
for  Items  Which  Met  Criteria  for  Inclusions  on  Monitoring  Survey 

Item  Total  Correlation  _ Item  Description _ 

Racial  Climate 

.78  Close  friendships  occur  between  blacks  &  whites 

.76  Black  &  white  soldiers  have  a  lot  in  common 

.74  Good  solutions  are  found  for  racial  problems 

.74  Blacks  &  whites  should  work  in  separate  groups 

.73  Whites  make  blacks  feel  unwelcome  in  areas 

open  to  all 

.73  Blacks  &  whites  hang  around  together  after  duty 

hours 

.71  How  often  does  racial  conflict  interfere  with 


Effectiveness  Center  &  School,  Note  13)  which  could  be  used  by  unit  commanders 
if  they  felt  the  need. 

An  alternative  approach  is  to  use  a  number  of  record  data  indices  to 
monitor  the  unit.  While  this  technique  does  not  have  the  obvious  face  validity 
of  the  perceptual  measures,  problems  involved  with  survey  administration  would 
be  avoided.  Figure  6  presents  one  possible  approach  to  a  monitoring  system 
which  uses  only  record  data.  This  technique  takes  advantage  of  the  fact  that 
Article  15s,  AWOLs,  MP  reports,  and  the  Promotion  and  Article  15  Discrimination 
Indicators  are  each  correlated  with  several  of  the  macro  scales.  Therefore, 
by  monitoring  these  few  variables,  a  commander  could  get  a  broad  and  relatively 
objective  secondary  index  of  what  the  perceived  effectiveness  of  the  unit  is 
likely  to  be.  A  further  advantage  of  using  these  particular  variables  is  that 
information  about  them  is  commonly  available  at  the  unit  or  battalion  level 
which  makes  it  easy  for  company  commanders  to  obtain  the  necessary  data. 

The  system  consists  of  a  worksheet  which  the  unit  commander  can  use  to 
monitor  these  record  data  variables.  The  information  required  and  the  techni¬ 
ques  used  were  made  as  simple  as  possible  so  that  users  could  complete  the 
exercise  with  a  minimum  of  effort.  As  Figure  6  shows,  items  1  and  2  of  the 
worksheet  ask  the  commander  to  estimate  the  number  of  Article  15s,  AWOLs,  and 
MP  reports  which  can  be  expected  in  his  unit,  using  linear  regression  equations 
estimated  from  the  data  collected  for  the  present  study.  The  questions  on  this 
part  of  the  worksheet  ask  the  commander  to  aggregate  the  data  over  a  period  of 
seven  months.  The  use  of  some  fairly  long  aggregation  interval  is  necessary 
to  smooth  out  random  deviations  and  provide  adequate  frequency  of  occurence 
for  these  variables.  Seven  months  was  used  in  this  case  simply  because  the 


Figure  6.  Prototype  unit  personnel  management  monitoring  system  work  sheet. 


1)  Excessive  Article  15s  can  he  an  indicator  of  future  trouble  in  your  unit. 
Too  many  Article  15s  may  actually  increase  lawbreaking.  To  see  if  your 
unit  has  more  Article  15s  than  the  typical  unit,  fill'  in  the  formula 
below  and  compare  the  result  with  the  number  of  Article  15s  in  your  unit 
over  the  last  7  months. 


a) 

#  of  El-E4s 
in  your  unit 


Expected 

ART15& 


Your  actual 
ART15&  over 
past  7  mos 


Article  15 
Difference 


X  .04  +  16.6  - 


2)  Excessive  MP  Reports  and  AWOLs  have  also  been  found  to  be  negative 
indicators  of  unit  effectiveness.  Complete  the  formula  below  to  see 
how  your  unit  compares  with  the  typical  unit  on  MP  Reports  and  AWOLs. 


a) 

#  of  El-E4s 
in  your  unit 


X  .29 


Expected 
MP  Reports 


Your  actual 
MP  Reports 
past  7  mos 


MP  Report 
Difference 


b) 

#  of  El-E4s 
in  your  unit 


Expected 

AWOLs 


Your  actual* 

AWOLs  over  AWOL 

past  7  mos  Difference 


X  .04  +  1.25  - 


3)  Racial  discrimination  in  punishment  and  promotion,  or  the  perception  of 

discrimination,  have  negative  effects  on  your  unit.  Sometimes  disproportion¬ 
ate  numbers  of  Article  15s  or  promotions  are  given  to  a  particular  racial 
group.  To  determine  if  Article  15s  or  promotions  have  been  given  out  dispro- 
potionately,  complete  the  formula  below. 

Promotions 

a) 

Total  promotions  Expected  Actual  // 

past  7  months  Black  Total  Black  of  Blacks 

E1-E4  E1-E4  Promotions  Promoted  Difference 

X  ( _  /  _ )  - 


*  Count  only  AWOLS  longer  than  24  hours. 


Figure  6  -  continued 
4)  Offense  Rates  (Optional) 


If  one  of  the  racial  groups  in  the  section  above  is  highly  overrepresented 
in  terms  of  punishment  it  may  be  justified  by  a  high  offense  rate  in  that 
group.  To  see  if  a  particular  racial  group  commits  more  than  its  share  of 
punishable  offences  complete  the  formula  below. 

a)  Actual  # 

Expected  MP  reports 

Total  MP  reports  Racial  Offense  Rate  &  AWOLs  for 

&  AWOLs  over  Group's  Total  for  Racial  Racial  Group  Offense  Rate 

past  7  mos  E1-E4  E1-E4  Group  past  7  mos  Difference 

_  ( _  /  _ )  =  _  -  _  =  _ 


If  the  offense  rate  difference  is  less  than  20%  of  the  actual  MP  reports  & 
AWOLs  for  that  racial  group  (Actual  MP  reports  x  .2)  then  the  overrepresent¬ 
ation  in  Article  15s  is  probably  not  justified  by  the  offense  rate. 


5)  Scoring 

Examine  the  various  differences  which  you  calculated  in  the  right  most  col¬ 
umn  of  each  page.  Fairly  large  negative  differences  (ie.  greater  than  20% 
of  the  corresponding  actual  number  of  occurrences)  indicate  areas  which 
should  be  of  concern.  Count  up  the  total  number  of  differences  greater 
than  20%  and  write  the  number  at  the  bottom  of  the  page.  You  can  use  this 
number  for  comparison  the  next  time  you  complete  this  form.  Remember  a 
high  score  means  the  indicators  are  more  negative,  a  low  score  means  the 
indicators  are  more  positive. 


Number  of 
Differences 
Greater  than  20%  * 


data  from  the  present  study  for  regression  estimates  was  available  in  that  form. 
In  practice,  a  more  convenient  interval  such  as  six  months  would  probably  be 
more  desirable. 

In  the  next  section  of  the  worksheet,  the  commander  estimates  the  number 
of  promotions  and  the  number  of  Article  15s  which  would  be  expected  for  each 
racial  group,  using  formulas  similar  to  those  used  for  DIs.  For  each  estimate 

throughout  the  worksheet,  the  commander  is  asked  to  make  a  comparison  with 
the  actual  number  of  promotions.  Article  15s,  etc.  by  subtracting  the  actual 
number  from  the  expected  number.  When  the  actual  number  of  an  indicator  is 
20%  greater  than  the  expected  number,  the  indicator  is  considered  negative. 

The  20%  figure  was  simply  chosen  arbitrarily,  and  is  designed  to  prevent  small 
inaccuracies  in  the  estimation  process  from  giving  negative  signals,  and  also 
to  be  easy  for  the  conmanders  to  use. 

It  should  be  pointed  out  that  a  worksheet  such  as  the  one  in  Figure  6 
would  not  be  applicable  to  all  types  of  units.  The  regression  equations  in 
items  one  and  two  in  particular  would  change,  since  different  types  of  units 
would  be  expected  to  have  different  underlying  rates  of  Article  15s,  AWOLs, 
etc.  As  an  addition  to  the  worksheet,  it  might  be  desirable  to  include  re¬ 
commendations  to  the  commander  on  what  should  be  done  if  the  worksheet  produces 
a  number  of  negative  indicators.  It  might  be  possible  to  key  a  particular 
record  data  indicator  to  the  questionnaire  items  in  Table  11,  to  give  the 
commander  a  series  of  statements  which  describe  the  perceptions  his  men  are 
likely  to  have.  Another  alternative  would  be  to  direct  leaders  to  the  appro¬ 
priate  sections  of  existing  Army  publications  such  as  FM  22-100  (Military 
Leadership,  Department  of  the  Army,  Note  14)  which  discuss  most  of  the  issues 
raised  by  the  questionnaire  items  and  also  suggests  appropriate  strategies 
for  dealing  with  those  issues. 


As  presently  designed,  the  work  sheet  could  be  utilized  as  a  manage¬ 
ment  aid  for  unit  level  commanders.  It  can  give  a  commander  a  rough  idea 
of  how  his  Article  15,  AWOL  and  MP  report  rate  compares  with  other  units 
via  the  normative  data  implied  in  the  regression  equations  used  in  items 
1  and  2.  It  can  also  indicate  the  presence  of  racial  bias  in  promotions 
and  punishment.  In  addition,  a  commander  could  track  long  term  trends 
in  these  areas  by  repeated  use  of  the  work  sheet  over  time.  The  work¬ 
sheet  is  not  intended  for  use  as  a  routine  reporting  document,  or  for 
formal  evaluation  purposes.  It  seems  likely  the  use  of  the  worksheet 
for  such  purposes  could  produce  distortions  in  the  data  which  would  in¬ 
validate  the  relationships  on  which  the  worksheet  was  based. 
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APPENDIX 


AN  EXAMINATION  OF  CROSS-LAGGED  PANEL  ANALYSIS 


LIST  OF  FIGURES 


ire 

Simulated  cross-correlations  for  synchronous  on-way  causal 
and  -purious  models  .  . 

Path  models  for  the  equations  used  to  gererate  the  simulated 
cross-correlations  in  Figure  1  . 

Simulated  cross-correlations  for  models  with  lagged  one-way 
causal  and  spurious  relationships  . 

Path  models  for  the  equations  used  to  gererate  the  simulated 
cross-correlations  in  Figure  3  . 

Simulated  cross-correlations  for  two  co-causal  models 

Path  models  of  equations  used  to  gererate  simulated  corss- 
lagged  correlations  shown  in  Figure  5  . 

Simulated  cross-correlations  form  a  co-causal  model  which 
have  not  been  averaged  . 


Cross-lagged  panel  analysis  was  originally  proposed  by  Campbell  and 
Stanley  (1963)  and  later  formalized  by  Kenny  (1973,  1975).  In  a  three¬ 
time  wave  design  such  as  the  present  study,  this  method  of  analysis  in¬ 
volves  calculation  of  three  different  groups  of  product-moment  correla¬ 
tion  coefficients  for  each  pair  of  measures  (X  and  Y) .  They  are:  1)  Syn¬ 
chronous  correlations  which  are  calculated  from  different  variables  meas¬ 
ured  at  the  same  time  (i.e.,  r  ..  , ,  r.  r  „  .  where  the  numeric  sub- 
scripts  represent  time) ;  2)  Cross-lagged  correlations  which  relate  dif¬ 

ferent  variables  measured  at  different  times  (rx^y2*  rx2y3*  rxly3 
X  leads  in  time,  and  rx2y^»  rx3y2*  rx3yl  ^  leads  in  time);  and 

3)  Autocorrelations  involving  a  single  variable  measured  at  different 

ti”s  (txl*2-  rx2x3’  rxlx3  for  X  and  ryly2’  ry2y3’  ryly3  £or 

Synchronous  correlations  are  the  type  used  in  traditional  single-time 

wave  studies.  Although  this  type  of  correlation  indicates  which  variables 
are  linearly  related,  it  gives  no  information  concerning  the  source  of 
the  relationship  (i.e.,  the  causality).  In  particular  three  basic  hypo¬ 
theses  are  confounded:  1)  X  is  causing  Y;  2)  Y  is  causing  X;  and  3)  the 
null  hypothesis  that  X  and  Y  are  related  because  they  are  both  being 
caused  by  a  spurious  third  variable.  Information  contained  in  the  cross- 
lagged  correlations  is  used  to  distinguish  between  these  rival  hypo¬ 
theses  by  assuming  that,  in  a  causal  relationship,  the  cross-lagged 
correlations  with  the  causal  variable  leading  in  time  will  be  larger 
than  the  cross-lagged  correlation  with  the  caused  variable  leading  in 
time.  Thus,  in  cross-lagged  panel  analysis,  the  magnitude  of  the  dif¬ 
ference  between  the  cross-lagged  correlations  is  used  to  indicate  the 


strength  of  the  causal  relationship  while  the  sign  of  the  difference  in- 


dicates  the  direction  of  causality. 


Take  for  example  the  following  cross- lagged  correlation:  rx^y2=,^®» 
rx2yi“«04*  The  cross-lagged  correlation  with  X  leading  is  highest,  pro¬ 
ducing  a  positive  cross-lagged  difference  of  .30  -  .04  =  .26.  This  re¬ 


sult  indicates  that  X  causes  increases  in  Y  because  the  cross-lagged  cor¬ 
relation  with  X  leading  (.30)  is  higher  than  the  cross-lagged  correlation 


with  Y  leading  (.04).  On  the  other  hand,  if  r  ,  =  .04  and  r  „  ,=.30,  the 

xly2  x2yl 

cross-lagged  difference  would  be  . 04- . 30=- . 26,  indicating  that  Y  causes  X 
because  the  cross-lagged  correlation  with  Y  leading  is  the  highest.  If 


r  ,  =  .30  and  r  _  .=.30,  cross- lagged  difference  would  be  .30  -  .30  =  0.0, 

xly2  x2yl  00 

indicating  that  the  correlation  between  X  and  Y  is  the  result  of  a  spurious 
third  variable. 

Unfortunately,  there  are  several  limitations  to  this  method  of  cross- 
lagged  analysis  which  make  its  application  in  the  present  study  problem¬ 
atic.  First  of  all,  the  model  only  handles  simple  two  variable  relation¬ 
ships  where  one  variable,  X,  causes  another  variable,  Y  (i.e.,  X — ^  Y) . 

The  model  cannot  identify  a  co-causal  relationship  where  each  variable 
causes  the  other  (i.e.,  X — ^Y— ^X).  In  a  study  of  complex  group  inter¬ 
actions  such  as  this  one  co-causal  relationships  can  be  expected  more  of¬ 
ten  than  not,  giving  cross-lagged  panel  analysis  limited  utility. 

Another  problem  with  cross-lagged  panel  analysis  is  that  it  cannot 
handle  more  than  two  time  waves.  Although  Kenny  (1974)  proposed  a  model 
for  three  wave  panel  analysis,  it  was  found  during  the  Task  A  analysis 
that  the  technique  lacked  sufficient  power  to  be  useful.  Other  research¬ 


ers  have  also  noted  this  problem  (eg.,  Schlegal  &  DeTecco,  Note  1).  Thus, 


lacking  a  better  method,  multiple  wave  designs  must  be  treated  simply  as 


a  series  of  two-wave  replications.  The  numerous  correlations  which  result 


from  this  process  make  the  control  of  the  Type  I  error  rate  more  difficult 
and  also  complicate  interpretation  of  the  results. 

Finally,  and  most  importantly,  a  number  of  researchers  (Heise,  1970; 

Pelz  and  Lew,  1970;  and  Rogosa,  1980)  have  pointed  out  several  situations 
in  which  simply  examining  the  differences  between  two-wave  cross  correla¬ 
tions  as  is  typically  done  in  cross- lagged  panel  analysis,  may  either;  1) 
indicate  no  causal  relationship  when  there  is  one;  2)  indicate  a  causal 
relationship  opposite  in  direction  or  sign  from  the  actual  causal  relation¬ 
ship;  or  3)  indicate  a  causal  relationship  where  none  exists.  Unfortunate¬ 
ly  ,  as  can  be  seen  from  the  discussion  which  follows,  these  are  not  rare 
situations,  but  rather,  are  so  pervasive  that  one  or  another  can  be  expec¬ 
ted  to  occur  in  nearly  every  panel  study. 

Figures  1  through  7  illustrate  a  number  of  situations  where  cross- 
lagged  panel  analysis  can  produce  misleading  results.  A  Monte  Carlo  sim¬ 
ulation  and  plotting  technique  originally  developed  by  Pelz  and  Lew  was 
used  to  create  the  figures.  Figure  1  shows  the  plotted  results  from  three 
runs  of  the  simulation.  The  graphs  in  the  figure  show  the  simulated 
cross-lagged  correlations  between  two  variables  plotted  as  a  function 
of  the  measurement  interval.  (The  measurement  interval  is  the  number 
of  simulated  time  periods  between  the  measurement  of  X  and  the  measure¬ 
ment  of  Y) .  Cross-correlations  in  which  Y  was  measured  first  in  time 
are  plotted  on  the  left  side  of  the  graph  and  the  measurement  interval 
is  shown  with  a  negative  sign.  Correlations  in  which  X  is  measured 
first  in  time  are  plotted  on  the  right  side  of  the  graph  and  have  a 
positive  measurement  interval.  Figure  la  shows  the  pattern  of  corre- 
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lations  generated  by  a  non-causal  model.  The  data  for  Figure  la  were  gen¬ 
erated  with  a  set  of  structural  equations  in  which  X  and  Y  are  caused  by  a 


spurious  third  variable,  Z,  with  a  path  coefficient  of  .55  (P  £  =  p 


y2 


,55).  X  and  Y  also  have  equal  autocorrelations  (P  =  P  =  .50)  and 

n  xx  yy 


equal  random  disturbances  (P^  =  P^  =  .67).  The  equations  used  to 


generate  la  are  shown  graphically  in  the  path  model  in  Figure  2a.  As  can 
be  seen  by  the  symmetry  of  the  curve  in  Figure  la,  this  model  produces 
roughly  equal  cross-correlations  (i.e.,  a  zero  cross-lagged  difference) 
at  any  particular  measurement  interval,  regardless  of  whether  X  or  Y  is 
measured  first  in  time.  In  this  case  at  least,  cross-lagged  panel  analy¬ 
sis  would  correctly  indicate  the  spurious  nature  of  the  X-Y  relationship. 

Correlations  from  a  simulated  causal  relationship  between  X  and  Y  are 
shown  in  Figure  lb.  The  equations  used  to  generate  Figure  lb  were  similar 
to  those  in  Figure  la  except  that  the  spurious  variable,  Z,  was  removed 
and  replaced  by  a  causal  path  leading  synchronously  from  X  to  Y  (this 
model  is  shown  in  the  path  diagram  Figure  2b).  In  this  case,  cross¬ 
correlations  at  a  given  measurement  interval,  which  are  significantly 
different  from  zero,  are  greater  on  the  right  side  of  the  graph  where  X 
is  measured  first  than  on  the  left  side  of  the  graph  where  Y  is  measured 
first.  Again,  in  this  situation,  cross- lagged  panel  analysis  would 
give  the  correct  indication  that  X  was  causing  Y,  but  only  if  the  re¬ 
searcher  happened  to  pick  a  measurement  interval  which  was  shorter 
than  4  time  intervals.  If  a  measurement  interval  longer  than  4  time 
intervals  was  used,  cross-lagged  panel  analysis  would  incorrectly  indi¬ 
cate  spuriousness.  This  is  because  both  cross-lagged  correlations 
would  be  approximately  equal  to  zero,  resulting  in  no  cross-lagged  dif- 


ference. 

Figure  lc  shows  a  pattern  of  cross  correlations  almost  identical  to 
the  causal  pattern  shown  in  lb,  however.  Figure  lc  was,  in  fact,  generated 
by  a  spurious  model  (shown  in  Figure  2c).  In  this  model,  like  the  model 
which  produced  la,  the  correlation  between  X  and  Y  is  due  to  the  spurious 
variable,  Z.  The  only  difference  between  the  two  spurious  models  is  that 
in  Figure  la  the  autocorrelations  of  X  and  Y  are  equal  while  in  lc  the 
autocorrelation  of  Y  is  greater  than  the  autocorrelation  of  X,  and  yet  in 
Figure  lc  cross-lagged  panel  analysis  would  indicate  incorrectly  that  X 
was  causing  Y.  Unequal  autocorrelations  can  also  bias  the  cross-lagged 
correlations  in  causal  relationships.  In  general,  as  Rogosa  (1980)  has 
pointed  out,  when  the  causal  or  spurious  effects  on  X  and  Y  are  equal, 
cross-lagged  panel  analysis  will  attribute  causality  to  the  variable 
with  the  lower  autocorrelations. 

The  simulated  examples  presented  up  to  this  point  have  dealt  with  situ¬ 
ations  in  which  the  causal  interval  was  smaller  than  the  smallest  measure¬ 
ment  interval.  This  was  simulated  by  having  causal  or  spurious  effects 
occur  synchronously.  Since  the  time  periods  used  in  simulation  are  ar¬ 
bitrary,  it  is  also  possible  to  simulate  situations  in  which  the  causal 
interval  is  longer  than  the  shortest  measurement  interval  by  using  lagged 
causal  or  spurious  factors.  This  procedure  is  used  in  Figure  3  to  illus¬ 
trate  another  situation  in  which  the  results  of  cross-lagged  panel  analy¬ 
sis  can  be  misleading  (Figure  4  shows  the  path  models  which  correspond 
to  the  graphs  in  Figure  3) .  While  the  correlation  patterns  in  all  of 
the  graphs  in  Figure  3  would  produce  cross-lagged  differences  at  cer¬ 
tain  measurement  intervals,  only  one.  Figure  3a,  was  produced  by  a  causal 


relationship . 

In  Figure  3a,  X  caused  Y  with  a  path  coefficient  of  .40  and  a  causal 
lag  of  4  measurement  intervals.  As  is  appropriate  for  the  underlying 
causal  model,  the  maximum  cross-lagged  difference  in  Figure  3a  occurs 
at  a  measurement  lag  of  4.  On  the  other  hand,  Figure  3b  shows  a  pattern 
of  correlations  almost  identical  to  Figure  3a,  generated  by  a  spurious 
model  in  which  a  third  variable,  Z,  caused  X  after  5  measurement  inter¬ 
vals,  and  Y  after  1  measurement  interval.  Just  like  the  causal  relation 
ship  in  Figure  3a,  the  spurious  relationship  in  Figure  3b  would  produce 
a  maximum  cross- lagged  difference  at  a  measurement  lag  of  4. 

Generally,  in  a  lagged  spurious  relationship  such  as  3b,  the  maximum 
cross- lagged  difference  will  occur  at  a  point  which  is  the  difference 
between  the  two  lags  for  the  effect  of  the  spurious  variable.  Thus  in 
Figure  3b,  the  maximum  cross-lagged  correlation  occurred  at  5-1-4. 

Figure  3c  also  shows  a  lagged  spurious  relationship,  this  time  Z  causes 
X  with  a  lag  of  5  and  Y  with  a  lag  of  15.  In  this  case  the  maximum 
cross-lagged  correlation  would  be  expected  to  (and  does)  occur  at  5-15- 
-10. 

It  should  be  apparent  from  the  preceding  discussion  that  the  utility 
of  cross- lagged  panel  analysis  for  distinguishing  between  spurious  and 
causal  relationships  in  situations  with  one  way  causality  is  negligible. 
A  similar  situation  exists  when  cross-lagged  panel  analysis  is  applied 
to  co-causal  relationships.  While  it  could  be  argued  that  cross-lagged 
panel  analysis  was  never  intended  for  use  in  co-causal  relationships, 
the  fact  is  that  very  few  researchers  using  cross-lagged  panel  analysis 
even  entertain  the  idea  that  the  variables  under  study  may  be  co-causal. 


As  will  be  shown  below,  this  practice  can  lead  to  misleading  and  seeming¬ 
ly  contradictory  results. 

The  graphs  in  Figure  5  show  simulated  cross  correlations  from  two  co- 
causal  relationships.  They  are  similar  to  a  graph  originally  presented 
in  Pelz  and  Lew  (1970),  and  correspond  to  the  path  models  shown  in  Figure 
6.  In  Figure  5a,  X  causes  Y  after  a  delay  of  three  time  periods  and  Y 
causes  X  after  a  delay  of  10  time  periods.  The  path  coefficients  for 
the  autocorrelations  for  both  X  and  Y  were  .50  while  the  path  coefficients 
for  the  cross  correlations  (X  causing  Y,  and  Y  causing  X)  were  .40.  Be¬ 
cause  of  the  dual  peaks  in  the  correlations,  cross-lagged  panel  studies 
examining  this  data  and  using  measurement  intervals  near  3  or  19  time 
periods  would  conclude  that  X  causes  Y.  On  the  other  hand,  studies  which 
used  measurement  intervals  near  10  and  25  would  come  to  the  opposite  con¬ 
clusion,  that  Y  causes  X.  While  neither  of  these  conclusions  is  strictly 
wrong,  a  researcher  looking  only  at  the  two  wave  cross-lagged  differences 
would  be  blind  to  the  actual  co-causal  nature  of  the  relationship.  It 
should  also  be  noted  that  researchers  dealing  with  variables  similar  to 
those  simulated  in  Figure  5a,  who  replicated  their  two  wave  study  at  dif¬ 
ferent  measurement  intervals  (as  Kenny,  1975,  recommends)  would  find  that 
their  various  replications  would  give  conflicting  results.  Even  more 
alarming  in  this  regard  is  the  case  of  a  reciprocal  co-causal  relation¬ 
ship,  such  as  the  one  shown  in  Figure  5b.  Figure  5b  was  generated  with 
a  model  similar  to  the  one  used  in  5a,  except  the  coefficient  for  Y 
causing  X  was  made  negative  (representing  a  negative  feedback  loop) . 

In  this  case,  a  researcher  using  multiple  replications  would  find  that 
the  sign  of  the  cross- lagged  difference  and  the  signs  of  the  cross-lagged 
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correlations  would  reverse  themselves  at  various  measurement  intervals; 
a  situation  for  which  there  is  no  basis  in  the  standard  models  for  cross 
lagged  panel  analysis. 

One  final  problem  which  the  simulation  revealed  was  a  fair  amount  of 
instability  in  cross- lagged  correlations,  especially  when  the  measure¬ 
ment  interval  deviated  from  the  causal  interval.  Although  the  curves 
presented  so  far  look  fairly  smooth  they  are,  in  fact,  average  curves 
with  each  point  based  on  many  correlations.  Figure  7  shows  a  graph  of 
individual  correlations  from  a  relationship  similar  to  that  shown  in 
Figure  5a.  The  five  different  curves  plotted  in  Figure  7  represent 
five  different  runs  of  the  simulation  (changing  only  the  sequence  of 
random  numbers  used  to  simulate  error).  The  figure  shows  that  even 
with  a  fairly  large  N  (200  cases  were  used  in  the  simulation)  cross- 
lagged  correlations  can  vary  randomly  over  a  fairly  wide  range  when 
the  measurement  Interval  deviates  from  the  causal  interval. 

To  deal  with  the  instability  problem,  the  curves  in  Figures  2  through 
6  were  smoothed  by  calculating  every  possible  non-redundant  correlation 
from  the  waves  of  simulated  data  represented  in  the  graph  and  then 
averaging  all  the  correlations  with  a  given  lag.  For  example,  corre¬ 
lations  between  X^Y^,  X^Y^  all  have  a  lag  of  1  and  would  be  av¬ 

eraged  together.  The  average  correlations  are  then  plotted  as  a  func¬ 
tion  of  measurement  lag.  For  example,  in  the  simulation  which  used 
50  waves,  cross-correlations  can  be  estimated  at  lags  up  to  50  time 
periods.  One  limitation  to  this  technique  is  that  averaged  correla¬ 
tions  at  the  longer  lags  are  made  up  of  fewer  individual  correlations 
than  averages  representing  shorter  lags.  In  the  present  example 


there  are  50  correlations  with  a  lag  of  1  but  only  26  correlations  with 
a  lag  of  25.  If  the  longest  possible  lag  of  50  were  of  interest,  only  1 
correlation  would  be  available  from  the  simulated  data  and  no  average 
could  be  calculated. 

Based  on  the  information  presented  above,  it  is  apparent  that  using 
cross- time  correlations  to  infer  causality  is  an  extremely  hazardous  pro¬ 
cedure  which  works  only  under  highly  specific  and  idealized  conditions. 
The  distinctive  double-peak  pattern  found  in  Figures  5a  and  5b  might  be 
useful  for  identifying  co-causal  relationships  in  studies  with  a  large 
number  of  replications  and  a  measurement  interval  shorter  than  the  causal 
interval.  However,  such  data  are  the  exception  rather  than  the  rule  in 
behavioral  research.  On  the  other  hand,  cross-time  correlations  can  be 
useful  in  the  predictive  sense.  It  is  certainly  useful  to  know  that 
variable  Y  at  time  2  can  be  predicted  to  some  degree  by  variable  X  at 
time  1,  and  cross- time  correlations  can  provide  that  information.  How¬ 
ever,  the  broader  question  of  whether  purposefully  manipulating  X  at 
time  1  will  produce  a  corresponding  change  in  Y  at  time  2  (i.e.,  whether 
X  causes  Y)  apparently  cannot  be  answered  using  present  cross-lagged 
correlation  techniques . * 


It  should  be  pointed  out  that,  like  cross- lagged  panel  analysis,  neither 
regression  nor  path  models  can  answer  the  question  of  causality,  ex¬ 
cept  by  assumption. 
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